sbbabu/kafka repository overview

Kafka version used is 2.12.0.11.0.1

This image can scale dynamically. Node ids are populated during run time based on the available nodes. Nodeid is in incremental order. If one of the node is down, the new container will acquire the missing node id in the series.

Prometheus metrics is build in, configure prometheus to scrape from :8020/

** List of Environment variables to be set ** ZooKeeper URL: queue_connect: zoo1:8121,zoo2:8121,zoo3:8121

Log Directory: Directory inside the consider where logs will be written. Sub directories will be created during run time based on node id. log_dirs:

ServiceName: service name of the host through which kafka will be accessed internalhostname:

LocalPort: Port at which internal services will be accessing kafka localport:

Remote HostName/IP: This is the IP at which remote server will connect to Kafka. This is advertise listen address of kafka. remotehostname:

Remote Listen Port: Port at which remote server will connect. remoteport:

Metrics for JMX - Optional paremeter where JMS metrics will be exposed. JMX_PORT:

---

version: '3.1' services: kafka1: image: knowesis/siftqueue:1.2 hostname: siftqueue1 ports: - 8021:8021
environment: queue_connect: zoo1:2181,zoo2:2182,zoo3:2183 log_dirs: /data/docker/kafka/ internalhostname: kafka1 localport: 9092 remotehostname: 10.x.x.100 remoteport: 8021 JMX_PORT: 3331