Mirror Kafka topics for your dev environment
10K+
This application mirrors Kafka topics from a cluster to your local machine as part of your development environment.
Note: This app is only intended for development purposes and should not be used for any kind of serious work.
You can download the CLI from the GitHub release page or Docker Hub (mortezaprk/kmir).
Usage:
kmir [OPTIONS] TOPICS...
Application Options:
--client-id Client ID [$CLIENT_ID]
--kafka-version Kafka version [$KAFKA_VERSION]
Source:
--source-brokers Comma-separated list of Kafka brokers [$SOURCE_BROKERS]
--source-timeout Timeout for Kafka (default: 10s) [$SOURCE_TIMEOUT]
TLS:
--source-tls-enabled Enable TLS [$SOURCE_TLS_ENABLED]
--source-tls-cert TLS certificate [$SOURCE_TLS_CERT]
--source-tls-insecure Skip TLS verification [$SOURCE_TLS_INSECURE]
SASL:
--source-sasl-enabled Enable SASL [$SOURCE_SASL_ENABLED]
--source-sasl-username SASL username [$SOURCE_SASL_USERNAME]
--source-sasl-password SASL password [$SOURCE_SASL_PASSWORD]
--source-sasl-mechanism SASL mechanism [$SOURCE_SASL_MECHANISM]
Sink:
--sink-brokers Comma-separated list of Kafka brokers [$SINK_BROKERS]
--sink-timeout Timeout for Kafka (default: 10s) [$SINK_TIMEOUT]
TLS:
--sink-tls-enabled Enable TLS [$SINK_TLS_ENABLED]
--sink-tls-cert TLS certificate [$SINK_TLS_CERT]
--sink-tls-insecure Skip TLS verification [$SINK_TLS_INSECURE]
SASL:
--sink-sasl-enabled Enable SASL [$SINK_SASL_ENABLED]
--sink-sasl-username SASL username [$SINK_SASL_USERNAME]
--sink-sasl-password SASL password [$SINK_SASL_PASSWORD]
--sink-sasl-mechanism SASL mechanism [$SINK_SASL_MECHANISM]
Help Options:
-h, --help Show this help message
The positional arguments, which specify the topic information, can be in any of the following forms:
topic_name: Mirrors the topic from the end.topic_name@offset: Mirrors the topic and all partitions starting from the given offset.topic_name@partition:offset,partition:offset: Only the mentioned partitions are mirrored from the given offset.Since this app uses
go-franzinternally, two offset values have specific meanings:
-1: From the end.-2or lower: From the start.
kmir --source-brokers=localhost:9092 --sink-brokers=localhost:9093 --client-id=my-client --kafka-version=2.7.0 topic1 topic2@-1 topic3@0:100,1:200
# Clone the repository
git clone https://mortz.dev/go/kmir.git
cd kmir
# Install dependencies
make deps
# Build the binary
make build
# Run all tests
make test
# Run short tests only
make test-short
# Generate coverage report
make coverage
# Run all CI checks
make ci
| Command | Description |
|---|---|
make build | Build the binary |
make test | Run tests with race detection |
make test-short | Run short tests only |
make lint | Run linters (golangci-lint) |
make fix | Auto-fix formatting issues |
make coverage | Generate coverage report |
make clean | Clean build artifacts |
make ci | Run full CI checks (lint, vulncheck, test) |
make deps | Download dependencies |
make deps-update | Update dependencies |
make vulncheck | Check for security vulnerabilities |
This project is licensed under the MIT License - see the LICENSE file for details.
Content type
Image
Digest
sha256:3b0a5ca9f…
Size
7.8 MB
Last updated
23 days ago
docker pull mortezaprk/kmir