Sign inSign up

ryanmtb/scrapyd_base

By ryanmtb

Updated about 11 years ago

base file for scrapyd. Use as a base and add your on scrapyd.conf file

Image
0

847

ryanmtb/scrapyd_base repository overview

FROM debian:jessie

RUN apt-get update
&& apt-get install -y autoconf
build-essential
curl
git
libffi-dev
libssl-dev
libtool
python
python-dev
vim-tiny
libpq-dev
python-psycopg2
&& mkdir libxml2
&& curl -sSL ftp://xmlsoft.org/libxml2/libxml2-2.9.2.tar.gz | tar xz --strip 1 -C libxml2
&& cd libxml2
&& ./configure --prefix=/usr
&& make
&& make install
&& ldconfig
&& cd ..
&& rm -rf libxml2
&& mkdir libxslt
&& curl -sSL https://git.gnome.org/browse/libxslt/snapshot/libxslt-1.1.28.tar.xz | tar xJ --strip 1 -C libxslt
&& cd libxslt
&& ./autogen.sh --prefix=/usr
&& make
&& make install
&& ldconfig
&& cd ..
&& rm -rf libxslt
&& curl -sSL https://bootstrap.pypa.io/get-pip.py | python
&& export LD_LIBRARY_PATH=/usr/local/postgresql/lib
&& pip install git+https://github.com/scrapy/scrapy.git
git+https://github.com/scrapy/scrapyd.git
git+https://github.com/scrapy/scrapyd-client.git
boto
psycopg2
python-dateutil
SQLAlchemy==1.0.8
&& curl -sSL https://github.com/scrapy/scrapy/raw/master/extras/scrapy_bash_completion -o /etc/bash_completion.d/scrapy_bash_completion
&& echo 'source /etc/bash_completion.d/scrapy_bash_completion' >> /root/.bashrc \

#ADD ./scrapyd.conf /etc/scrapyd/ #VOLUME /etc/scrapyd/ /var/lib/scrapyd/ #EXPOSE 6800

#CMD ["scrapyd"]

Tag summary

Content type

Image

Digest

sha256:47ddd89d1

Size

239.3 MB

Last updated

about 11 years ago

docker pull ryanmtb/scrapyd_base