alnoda/kafka-workspace repository overview

⁠Kafka workspace

Portable containerized workspace to interact with Kafka clusters.

⁠Start

docker run --name rwid-1 -d -p 8020-8040:8020-8040 --restart=always alnoda/kafka-workspace

open localhost:8020⁠ in browser.

⁠Features

Kafka CLI tools

• Apache Kafka⁠ - single-node cluster for experimentation
• kcat⁠ - generic non-JVM producer and consumer for Apache Kafka.
• kafkactl⁠ - command-line interface for interaction with Apache Kafka.
• trubka⁠ - Kafka CLI tool built in Go which gives you everything you need.
• kt⁠ - Kafka tool that likes JSON.
• kcli⁠ - Kafka read only command line browser.
• Codeserver workspace features⁠

⁠Links

Alnoda docs⁠
Alnoda Hub⁠

⁠Kafka tools

Kafka distribution itself contains command line tools that allow to create topics, send and consume events, etc. Open workspace terminal http://localhost:8026/⁠ and go to Kafka directory

cd /home/abc/kafka

• create topic

bin/kafka-topics.sh --create --partitions 1 --replication-factor 1 --topic quickstart-events --bootstrap-server localhost:9092

• send some messages

bin/kafka-console-producer.sh --topic quickstart-events --bootstrap-server localhost:9092

• consume messages

bin/kafka-console-consumer.sh --topic quickstart-events --from-beginning --bootstrap-server localhost:9092

⁠kt⁠

Kafka tool that likes JSON.

Configure brokers, topic, Kafka version and authentication via environment variables KT_BROKERS, KT_TOPIC, KT_KAFKA_VERSION and KT_AUTH.

• Set topic to "quickstart-events" (local Kafka instance by default)

export KT_TOPIC="quickstart-events"

• Get information about topics, brockers and consumer groups

kt topic 
kt group

• consume messages

kt consume 

• produce messages

echo 'Bob wins Oscar' | kt produce -topic quickstart-events -literal

⁠kafkactl⁠

A command-line interface for interaction with Apache Kafka.

• Consume from topic "quickstart-events"

kafkactl consume  quickstart-events --from-beginning
kafkactl consume quickstart-events --from-beginning --print-keys --print-timestamps -o yaml

⁠kcat⁠

Generic non-JVM producer and consumer for Apache Kafka.

• Consume topic "quickstart-events"

kafkacat -b localhost -t quickstart-events

• Produce events to the topic

echo "Hello World" | kafkacat -b localhost -t quickstart-events

⁠kcli⁠

Kafka read only command line browser

Launch kcli in the Workspace terminal

kcli

⁠trubka⁠

Kafka CLI tool built in Go which gives you everything you need.

• Consume from the topic "quickstart-events"

trubka consume plain quickstart-events --brokers localhost:9092

• Produce message to the topic

trubka produce plain quickstart-events "Random Data" --brokers localhost:9092