Sign inSign up

semagrow/sevod-scraper

By semagrow

•Updated over 5 years ago

Docker container to run the sevod-scraper tool

Image
1

467

semagrow/sevod-scraper repository overview

⁠docker-sevod-scraper

This is the docker container for sevod-scraper. Sevod-scraper is a tool to create dataset metadata for Semagrow.

To build docker-sevod-scraper go into the clone directory and run

docker build -t sevod-scraper .

As an example, suppose that your dataset is stored locally in /my/path/dump.nt and its SPARQL endpoint is http://localhost:8080/sparql. To extract its metadata for Semagrow, issue the following command:

docker run --rm \
   -e MODE=rdfdump \
   -e INPUT=/share/dump.nt \
   -e OUTPUT=/share/metadata.ttl \
   -e ENDPOINT=http://localhost:8890/sparql \
   -v /my/path:/share \
  sevod-scraper

The result of sevod-scraper should appear in /my/path/metadata.ttl.

In general, you can control the sevod-scraper using the following environment variables:

VariableDescription
MODEDetermines the type of the input. Possible values:
 rdfdump: input is a path to an RDF file in ntriples format
 geordfdump: input is a path to geospatial RDF file in ntriples format
 cassandra: input is a Cassandra keyspace
 sparql: input is a SPARQL endpoint
INPUTinput (type of input determined by MODE)
OUTPUTpath to write the output
ENDPOINTSPARQL endpoint URL (used for annotation only)
PREFIXESList of known URI prefixes (comma-separated)
GRAPHGraph (only for SPARQL endpoint)
POLYGONKnown bounding polygon (for geospatial RDF files)
NAMESPACENamespace for URI mappings (only for cassandra)

For more info about the tool and more examples see https://github.com/semagrow/sevod-scraper⁠

Tag summary

Content type

Image

Digest

Size

115.7 MB

Last updated

over 5 years ago

docker pull semagrow/sevod-scraper