PHP Classes

ReconCat: Retrieve past versions pages from Web Archive

Recommend this page to a friend!
  Info   Documentation   Screenshots   View files Files   Install with Composer Install with Composer   Download Download   Reputation   Support forum   Blog    
Ratings Unique User Downloads Download Rankings
Not yet rated by the usersTotal: 41 All time: 10,897 This week: 524Up
Version License PHP version Categories
reconcat 1.0MIT/X Consortium ...5PHP 5, Web services
Description 

Author

This package can retrieve past version pages from Web Archive.

It provides an application can that takes parameters to define URLs and years of past versions of Web pages.

The package can send HTTP requests to the Web Archive site to retrieve the data of specified Web pages.

It can also use a given number of threads to retrieve many Web pages in parallel.

Innovation Award
PHP Programming Innovation award nominee
October 2022
Number 7
The Web Archive is a site that can show past versions of Web site pages. It provides a service that retrieves Web pages on different dates.

This way, it is possible to retrieve the contents of a given page as it was on past dates.

This package provides a command written in PHP that you can run from the command line console to retrieve many versions of the same. It can use threads to retrieve many pages faster.

The ability to retrieve past versions of a page can help detect changes caused by security incidents.

Security professionals can compare the versions of the same page to find pages that were changed and may need a new security auditing process to determine if people with bad intentions caused the changes.

Manuel Lemos
Picture of Dawood Ikhlaq
  Performance   Level  
Innovation award
Innovation award
Nominee: 4x

 

Documentation

Recon Cat

=========================================

Introduction

A small Php application to fetch archive url snapshots from archive.org. using it you can fetch complete list of snapshot urls of any year or complete list of all years possible. Made Specially for penetration testing purpose. This application is powered by WMB-Scrapper

Installation

Clone this repository,

    git clone https://github.com/daudmalik06/ReconCat
    cd ReconCat
    php recon

Requirements

  • This application requires php 7+
  • multi threading is available as optional, if you have php pthreads installed you can use that to speed up the process.

Information

  • it saves all snapshots in Output directory, e,g for google.com it will make a directory as `Output/google.com` and will save all related snapshot in that directory
  • all snapshot will be saved on year bases, i.e snapshot of every year will be saved in different file e.g 2009_google.com .
  • threads are used for fetching several(year based) snapshot concurrently
  • single year snapshot is fetched in a single thread

    ## Usage

For help

php recon --help

ReconCat Example ReconCat Help

Other commands

php recon --url=https://github.com -t10  (fetch all snapshot of github with 10 threads)
php recon -y2012 --url=https://github.com -t10  (fetch snapshot of year 2012 of github with 10 threads)

License

The Recon Cat is open-sourced software licensed under the MIT license.

Contribution

Thanks to all of the contributors ,

Author

Dawood Ikhlaq and Open source community



Screenshots (2)  
  • src/reconCatExample.JPG
  • src/reconCatHelp2.JPG
  Files folder image Files (421)  
File Role Description
Files folder imagesrc (2 files, 1 directory)
Files folder imagevendor (1 file, 5 directories)
Accessible without login Plain text file composer.json Data Auxiliary data
Accessible without login Plain text file composer.lock Data Auxiliary data
Accessible without login Plain text file README.md Doc. Documentation
Accessible without login Plain text file recon Appl. Command line application script

The PHP Classes site has supported package installation using the Composer tool since 2013, as you may verify by reading this instructions page.
Install with Composer Install with Composer
 Version Control Unique User Downloads Download Rankings  
 100%
Total:41
This week:0
All time:10,897
This week:524Up