This is a scrapyd service image with basic HTTP authentication through nginx.
Scrapyd listens on 6810 and is not exposed from the container.
Nginx listens on 6800 (exposed), performs basic HTTP authentication and forwards to scrapyd on 6810.
/var/lib/scrapyd is exposed as a volume and contains scrapyd logs and databases.
Beware to change the sampleusr/samplepwd supplied in the
/etc/nginx/.htpasswd file! You can do so at container runtime by using
docker run -e USER=[username] -e PASSWORD=[password].
In order to facilitate health checks, nginx returns the scrapyd home page without authentication on the
Sample usage :
docker run -d -p 6800:6800 -e USER=[user] -e PASSWORD=[password] -v /var/lib/scrapyd:/var/lib/scrapyd multimediapress/scrapyd