Public | Automated Build

Last pushed: 18 days ago
Short Description
SerpScrap out of the box. Image is based on ecoron/python36-sklearn. dependencies already installed.
Full Description



.. image::

.. image::
:alt: Documentation Status

.. image::

.. image::

SEO python scraper to extract and analyze data from major search engine serps or text content of any other url.
Extract data like title, url, type, text- and richsnippet of searchresults for given keywords. detect ads, automated screenshots.
It might be usefull for SEO and research tasks.

Extract these result types

  • ads_main - advertisements within regular search results
  • image - result from image search
  • news - news teaser within regular search results
  • results - standard search result
  • shopping - shopping teaser within regular search results

For each result in a resultspage get

  • domain
  • rank
  • rich snippet
  • site links
  • snippet
  • title
  • type
  • url
  • visible url

Also get a screenshot of each result page.
You can also scrape the text content of each result url.
It also possible to save the results as CSV for future analytics.
If required you can use your own proxylist.


See for documentation.

Source is available at


The easy way to do:

.. code-block:: python

pip uninstall SerpScrap -y
pip install SerpScrap --upgrade

More details in the install_ section of the documentation.


SerpScrap in your applications

.. code-block:: python


-- coding: utf-8 --

import pprint
import serpscrap

keywords = ['example']

config = serpscrap.Config()
config.set('scrape_urls', False)

scrap = serpscrap.SerpScrap()
scrap.init(config=config.get(), keywords=keywords)
results =

for result in results:

More detailes in the examples_ section of the documentation.

To avoid encode/decode issues use this command before you start using SerpScrap in your cli.

.. code-block:: bash

chcp 65001

.. image::


Notes about major changes between releases


  • support for headless chrome, adjusted default time between scrapes


  • result types added (news, shopping, image)
  • Image search is supported


  • text processing tools removed.
  • less requirements


SerpScrap is using PhantomJs_ a scriptable headless WebKit, which is installed automaticly on the first run (Linux, Windows).
The scrapcore is based on GoogleScraper_ with several improvements.

.. target-notes::

.. _install:
.. _examples:
.. _PhantomJs:
.. _GoogleScraper:

Docker Pull Command
Source Repository