scrapydata

scrapyd server with 6801 port, based on scrapyd, scrapy, scrapy-redis, seleniume, js module.

Distributed Crawler Management B/S Application, based on scrapy and scrapyd.