Incredibly fast crawler designed for OSINT. https://github.com/s0md3v/Photon
929
Usage:
docker pull snowsecurity/photon:latest
docker run -it --name photon -v "$PWD:/Photon/google.com" snowsecurity/photon:latest -u google.com
Key Features Data Extraction
Photon can extract the following data while crawling:
URLs (in-scope & out-of-scope)
URLs with parameters (example.com/gallery.php?id=2)
Intel (emails, social media accounts, amazon buckets etc.)
Files (pdf, png, xml etc.)
Secret keys (auth/API keys & hashes)
JavaScript files & Endpoints present in them
Strings matching custom regex pattern
Subdomains & DNS related data
The extracted information is saved in an organized manner or can be exported as json. Flexible
Control timeout, delay, add seeds, exclude URLs matching a regex pattern and other cool stuff. The extensive range of options provided by Photon lets you crawl the web exactly the way you want. Genius
Photon's smart thread management & refined logic gives you top notch performance.
Still, crawling can be resource intensive but Photon has some tricks up it's sleeves. You can fetch URLs archived by archive.org to be used as seeds by using --wayback option. Plugins
wayback
dnsdumpster
Exporter
$ docker build -t photon . $ docker run -it --name photon photon:latest -u google.com
To view results, you can either head over to the local docker volume, which you can find by running docker inspect photon or by mounting the target loot folder: $PWD:/Photon/namefolder/
$ docker run -it --name photon -v "$PWD:/Photon/google.com" photon:latest -u google.com
Content type
Image
Digest
Size
45.1 MB
Last updated
almost 7 years ago
docker pull snowsecurity/photon