qubyte/sitemapper repository overview

⁠sitemapper

A demo cli wrapper around sitemap⁠. To use, run:

docker run qubyte/sitemapper --start-url <put a URL to start from here> --jobs <workers>

--start-url is mandatory, --jobs defaults to 1. --jobs is the number of sites to allow the program to request and process simultanously. For large sites, consider using this argument.