sysflowtelemetry/sf-processor
Dockerfile
linksDocumentation: the SysFlow Documentation
Where to get help: the SysFlow Community Slack
Where to file issues:
the github issue tracker (include the sf-processor
tag)
Source of this description: repo's readme (history)
Docker images: docker hub | GHCR
The SysFlow Telemetry Pipeline is a framework for monitoring cloud workloads and for creating performance and security analytics. The goal of this project is to build all the plumbing required for system telemetry so that users can focus on writing and sharing analytics on a scalable, common open-source platform. The backbone of the telemetry pipeline is a new data format called SysFlow, which lifts raw system event information into an abstraction that describes process behaviors, and their relationships with containers, files, and network. This object-relational format is highly compact, yet it provides broad visibility into container clouds. We have also built several APIs that allow users to process SysFlow with their favorite toolkits. Learn more about SysFlow in the SysFlow documentation.
The SysFlow framework consists of the following sub-projects:
The SysFlow processor is a lighweight edge analytics pipeline that can process and enrich SysFlow data. The processor is written in golang, and allows users to build and configure various pipelines using a set of built-in and custom plugins and drivers. Pipeline plugins are producer-consumer objects that follow an interface and pass data to one another through pre-defined channels in a multi-threaded environment. By contrast, a driver represents a data source, which pushes data to the plugins. The processor currently supports two builtin drivers, including one that reads sysflow from a file, and another that reads streaming sysflow over a domain socket. Plugins and drivers are configured using a JSON file.
Please check Sysflow Processor for documentation on deployment and configuration options.
The easiest way to run the SysFlow Processor is by using docker-compose. The provided docker-compose.processor.yml
file deploys the SysFlow processor and collector. The rsyslog endpoint should be configured in ./config/.env.processor
. Collector settings can be changed in ./config/.env.collector
. Additional settings can be configured directly in the compose file.
docker-compose -f docker-compose.processor.yml up
Instructions for docker-compose
, helm
, and oc operator
deployments are available here. Alternatively, you can install the SysFlow Processor using its binary installers available in the release pages.
View license information for the software contained in this image.
As with all Docker images, these likely also contain other software which may be under other licenses (such as Bash, etc from the base distribution, along with any direct or indirect dependencies of the primary software being contained).
As for any pre-built image usage, it is the image user's responsibility to ensure that any use of this image complies with any relevant licenses for all software contained within.
docker pull sysflowtelemetry/sf-processor