Sign inSign up

calinora/pilot

By calinora

•Updated 2 days ago

Real-time Kafka monitoring and intelligent partition rebalancing.

Image
1

4.6K

calinora/pilot repository overview

⁠Calinora Pilot

Calinora Pilot is an all-in-one, container-native tool that live-samples Kafka traffic, scores partition activity, exposes management APIs (including intelligent partition redistribution), and displays everything in a modern React dashboard.

⁠Quick Start

docker run -d \
  --name pilot \
  -p 8080:8080 \
  -e KAFKA_BOOTSTRAP_SERVERS=your-kafka-broker:9092 \
  calinora/pilot:latest

Access the dashboard at http://localhost:8080

⁠Features

  • Live Traffic Sampling - real-time Kafka partition activity monitoring
  • Intelligent Rebalancing - rack-aware partition redistribution with a 10-phase proposal pipeline
  • Self-Healing - automatic critical repairs and rebalancing with configurable time windows
  • Modern Dashboard - React UI for cluster visualization, message browsing, and management
  • AI Chat & MCP - optional AI assistant and Model Context Protocol server with 56 tools
  • Management APIs - RESTful API with 86+ endpoints for full cluster operations
  • Security - SSL/TLS, SASL (PLAIN, SCRAM, GSSAPI, OAUTHBEARER), OAuth2/OIDC UI auth
  • Container Native - single distroless binary (~20MB), Docker and Kubernetes ready

⁠Docker Compose

services:
  broker:
    image: apache/kafka:latest
    environment:
      KAFKA_NODE_ID: 1
      KAFKA_PROCESS_ROLES: broker,controller
      KAFKA_LISTENERS: PLAINTEXT://:9092,CONTROLLER://:9093
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://broker:9092
      KAFKA_CONTROLLER_LISTENER_NAMES: CONTROLLER
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
      KAFKA_CONTROLLER_QUORUM_VOTERS: 1@broker:9093
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
      KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
      KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1

  pilot:
    image: calinora/pilot:latest
    depends_on: [broker]
    ports: ["8080:8080"]
    environment:
      KAFKA_BOOTSTRAP_SERVERS: broker:9092

⁠Essential Configuration

VariableDefaultDescription
KAFKA_BOOTSTRAP_SERVERSlocalhost:9092Kafka broker addresses (comma-separated)
PORT8080HTTP server port
LOG_LEVELINFOLogging level (DEBUG, INFO, WARN)
LICENSE_STRING-JWT license token (unlocks management operations)
KAFKA_SECURITY_PROTOCOLPLAINTEXTPLAINTEXT, SSL, SASL_PLAINTEXT, SASL_SSL

⁠License

Pilot works without a license for all monitoring and read-only operations. A license unlocks management features (reassignments, config changes, maintenance mode, self-healing). Visit calinora.io⁠ or email [email protected]⁠.

⁠Health Checks

  • Liveness: GET /api/v1/health
  • Readiness: GET /api/v1/ready

⁠Documentation

Full documentation including configuration reference, deployment guides, API reference, and feature guides:

docs.calinora.io⁠


Built with ❤️ by Calinora⁠

Tag summary

Content type

Image

Digest

sha256:e72c5a5be…

Size

12.8 MB

Last updated

2 days ago

docker pull calinora/pilot