Sign inSign up

mechaid/data-scraping

By mechaid

•Updated over 5 years ago

Data scraping using Python & Selenium

Image
0

84

mechaid/data-scraping repository overview

⁠Data Scraping Docker - mecha.id

⁠Installation

$ docker pull mechaid/data-scraping:0.1-chrome

Build image locally :

$ git clone https://github.com/snowheat/data-scraping-docker
$ cd data-scraping-docker/buster-selenium-vim-python
$ docker build -t "mechaid/data-scraping" .

⁠Executing Scraping Script

  1. Create scraping script on the host, for example :
from selenium import webdriver
from selenium.webdriver.chrome.options import Options

options = Options()
options.add_argument('--headless')
options.add_argument('--no-sandbox')
options.add_argument('--disable-dev-shm-usage')

driver = webdriver.Chrome("/bin/chromedriver", options=options)
driver.get("https://mecha.id")

print(driver.title)

driver.quit()
  1. Run docker command
$ docker run -it -v ${PWD}/scripts:/scripts mechaid/data-scraping:0.1-chrome python /scripts/scraping-example.py

Tag summary

Content type

Image

Digest

Size

380.5 MB

Last updated

over 5 years ago

docker pull mechaid/data-scraping:0.1-chrome