gravwell/kafka_consumer repository overview

The Gravwell Kafka ingester can feed from a Kafka message bus and transport data into Gravwell. The Kafka consumer can feed from multiple topics at once and transmit entries into a single Gravwell instance or a full Gravwell cluster.

For more information on configuring the Gravwell Kafka consumer see Kafka section⁠ of our ingesters documentation.

Refer to Gravwell's Docker guide⁠ for information on how to deploy ingester containers.

Note: Because this is a Linux application, we strongly recommend running under Docker on a Linux host. Performance may suffer on other operating systems. MacOS users cannot access containers directly by IP, because the containers are actually run within a Linux VM. You can either use netcat from within a Docker container (either the same container or a new one), or forward the appropriate ingester ports to the host when launching the Gravwell container