Public | Automated Build

Last pushed: 6 months ago
Short Description
A collection of spiders for extracting designs from daily tee websites.
Full Description

Daily Tee Deals - Scrapers

A collection of Scrapy spiders for extracting designs from daily tee websites, including: ShirtPunch, Teefury, Yetee, Qwertee and 40+ other sites.


docker run -p 6800:6800 -p 6900:6900 -it harrisbaird/dailyteedeals_scrapers

Two services will now be running:

  • Scrapyd on 6800
  • Flask on 6900

The Flask service provides the following endpoints for convenience:

  • [GET] /status/<job_id> - Get the status of a job. returns 'running', 'pending', 'finished' or '' for unknown state.
  • [GET] /download/<job_id> - Download the item feed of a job in JsonLines / .jl format.
  • [POST] /schedule/<spider> - Schedule a job with the given spider name, returning a job id.

Alternatively, the scrapyd service can be called directly.

Example JSON output

    "name": "Abbey road", 
    "url": "",
    "active": true, 
    "deal": true,
    "last_chance": true, 
    "expires_at": "2017-07-07T23:00:00Z", 
    "valid": true,
    "image_url": "",
    "artist_name": "Darthdaloon",
    "artist_urls": [
    "prices": {
        "usd": 1200,
        "gbp": 900,
        "eur": 1100
    "fabric_colors": [], 
    "tags": []
Docker Pull Command