Sign inSign up

andreaskoch/gargantua

By andreaskoch

•Updated over 9 years ago

The fast website crawler

Image
1

609

andreaskoch/gargantua repository overview

⁠「 gargantua 」

The fast website crawler

GitHub: https://github.com/andreaskoch/gargantua⁠

⁠Usage

Crawl www.sitemaps.org⁠ with 5 concurrent workers:

docker run --rm andreaskoch/gargantua:latest \
       crawl --verbose \
       --url https://www.sitemaps.org/sitemap.xml \
       --workers 5

Tag summary

Content type

Image

Digest

Size

6 MB

Last updated

over 9 years ago

docker pull andreaskoch/gargantua