ibuyro/spiders repository overview

#Search app crawling app

Python enviroment for scrapy

Dependencies: Python and stdlib modules for puppet

This project uses scrapy for crawling (doc here: http://doc.scrapy.org/en/1.1/⁠)