Sign inSign up

prikid/docker_python_scrapy_selenium_geckodriver

By prikid

•Updated over 1 year ago

python:3.9-alpine with geckodriver, firefox-esr, Scrapy, selenium, scrapy-selenium, psycopg2, pandas

Image
0

919

prikid/docker_python_scrapy_selenium_geckodriver repository overview

⁠Based on python:3.9-alpine with installed geckodriver, firefox-esr, Scrapy, selenium, scrapy-selenium, psycopg2, SQLAlchemy, pandas, rq, redis, python-dotenv, python-dateutil

To use with the Scrapy add the following lines to the settings.py file of the spider:

DOWNLOADER_MIDDLEWARES = {
    'scrapy_selenium.SeleniumMiddleware': 800
}

SELENIUM_DRIVER_NAME = 'firefox'
SELENIUM_DRIVER_EXECUTABLE_PATH = os.getenv('WEBDRIVER_PATH')
SELENIUM_BROWSER_EXECUTABLE_PATH = os.getenv('FIREFOX_BIN')
SELENIUM_DRIVER_ARGUMENTS = [
    '--headless',
    '--disable-extensions',
    '--no-sandbox',
    '--disable-application-cache',
    '--disable-gpu',
    '--disable-dev-shm-usage',
    '--disable-infobars',
    '--start-maximized'
]

Tag summary

Content type

Image

Digest

sha256:f48ea8c77…

Size

468.9 MB

Last updated

over 1 year ago

docker pull prikid/docker_python_scrapy_selenium_geckodriver:3.13-slim_bookworm