Utilities for Social Feed Manager.
- BaseConsumer: Base class for consuming messages from Rabbit.
- BaseHarvester: Base class for a harvester, allowing harvesting from a queue or from a file.
- StreamConsumer: A consumer intended to control stream harvests using Supervisor.
- warced: An entry/exit wrapper for warcprox.
git clone https://github.com/gwu-libraries/sfm-utils.git cd sfm-utils pip install -r requirements/requirements.txt
requirements/requirements.txt references the latest releast of warcprox-gwu.
If you are doing development on the interaction between warcprox-gwu and
requirements/dev.txt. This uses a local copy (
of warcprox-gwu in editable mode.
Alternatively, it can be included as a dependency by adding the following to
#Replace 0.1.0 with the version that you want. git+https://email@example.com#egg=sfmutils #If using any of the consumers or harvesters librabbitmq==1.6.1 #If using BaseHarvester git+https://github.com/gwu-libraries/warcprox.git@master#egg=warcprox-gwu
python -m unittest discover