Store URL sets in the Internet Archive and generate an index file from the Metadata.
10K+
The image contains a TOR service that rotates the IP every 10 seconds, a Socks proxy and a headless Firefox. The script is located in /usr/src/archive/. From command line do
docker run -it --name "my-container" --mount type=bind, src=/path/to/my_urls.txt, destination=/usr/src/archive/urls.txt archaeopath/archive.pl-docker /bin/bash
docker exec archive.pl-custom /bin/bash -c "perl archive.pl -lFT .4 -P 'socks4://localhost:9050' -n 'username' -p 'password' -z 'Europe/Berlin' -d '1' -i 'A Title' -u 'https://my.wordpress.com/xmlrpc.php'" > /path/to/my.log 2>&1
In detach mode (fi. in a shell script) you have to start TOR and Firefox manually:
docker run -dit --name "my-container" --mount type=bind, src=/path/to/my_urls.txt, destination=/usr/src/archive/urls.txt archaeopath/archive.pl-docker /bin/bash
docker exec archive.pl-custom /bin/bash -c "./init.sh; perl archive.pl -lFT .4 -P 'socks4://localhost:9050' -n 'username' -p 'password' -z 'Europe/Berlin' -d '1' -i 'A Title' -u 'https://my.wordpress.com/xmlrpc.php'" > /path/to/my.log 2>&1
Content type
Image
Digest
sha256:c85637966…
Size
494.7 MB
Last updated
6 days ago
docker pull archaeopath/archive.pl-docker