Public | Automated Build

Last pushed: 2 years ago
Short Description
Ingestion Framework for Smart Data Web
Full Description

Smart Data Web

Smart Data Web is a BMWi funded project. The central goal of the Smart Data Web project is to leverage state-of-the-art data extraction and enrichment technologies as well as Linked Data to create value-added systems for the German industry. Knowledge which is relevant to decision-making processes will be extracted from government and industry data, official web pages and social media. Then the data will be analyzed using natural language processing frameworks and then it will be integrated into knowledge graphs. These knowledge graphs will be accessible via dashboards and APIs, as well as via Linked Data. Special concern will be given to legal questions, such as data licensing as well as data security and privacy.

Architecture Diagram


  • Java 1.8.x
  • Maven 3.3.x

Tools and Dependencies:

  • Apache Flink
  • Apache Jena
  • Apache Commons-configurations2
  • RabbitMQ
  • Quartz Scheduler
  • RML mapping language
  • R2RML mapping language
  • Docker
  • Sonarqube
  • Redis

Project build:

mvn clean install -DskipTests

Running the framework from command line:

java -cp ".:target/sdw-1.0.jar:./lib/*" org.sdw.Main

mvn exec:java -Dexec.mainClass="org.sdw.Main"

Docker build:

sudo docker build -t gonephishing/sdw .

Code Quality:

Sonarqube has been used for dependency analysis and maintaining the code quality. If the sonarqube server is running during maven build time, the quality report generated can be accessed on http://localhost:9000


The project has been released under Apache Software License 2.0

Docker Pull Command
Source Repository