aciobanu/scrapy repository overview

⁠Scrapy

An open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way.

See scrapy⁠ official page and the official documentation⁠ for more details.

⁠Usage

For a list of scrapy⁠ commands, simply run:

$ docker run -v $(pwd):/runtime/app aciobanu/scrapy

Since the container doesn't provide any persistence, we can use the volumes (-v) directive to share the current folder with the container.

To start a new project

$ docker run -v $(pwd):/runtime/app aciobanu/scrapy startproject tutorial

This will create a new tutorial folder in your current path.

To work on the scrapy⁠ project:

$ cd tutorial
$ docker run -v $(pwd):/runtime/app aciobanu/scrapy

Continue reading the official tutorial⁠ for a more in depth usage manual of scrapy⁠. For more details about Docker⁠ and usage options, please see the official documentation⁠ page.