Sign inSign up

calinora/pilot

By calinora

Updated 12 days ago

Real-time Kafka monitoring and intelligent partition rebalancing.

Image
1

4.4K

calinora/pilot repository overview

Calinora Pilot

Calinora Pilot is an all-in-one, container-native tool that live-samples Kafka traffic, scores partition activity, exposes management APIs (including intelligent partition redistribution), and displays everything in a modern React dashboard.

Quick Start

docker run -d \
  --name pilot \
  -p 8080:8080 \
  -e KAFKA_BOOTSTRAP_SERVERS=your-kafka-broker:9092 \
  calinora/pilot:latest

Access the dashboard at http://localhost:8080

Features

  • Live Traffic Sampling - real-time Kafka partition activity monitoring
  • Intelligent Rebalancing - rack-aware partition redistribution with a 10-phase proposal pipeline
  • Self-Healing - automatic critical repairs and rebalancing with configurable time windows
  • Modern Dashboard - React UI for cluster visualization, message browsing, and management
  • AI Chat & MCP - optional AI assistant and Model Context Protocol server with 67+ tools
  • Management APIs - RESTful API with 86+ endpoints for full cluster operations
  • Security - SSL/TLS, SASL (PLAIN, SCRAM, GSSAPI, OAUTHBEARER), OAuth2/OIDC UI auth
  • Container Native - single distroless binary (~20MB), Docker and Kubernetes ready

Docker Compose

services:
  broker:
    image: apache/kafka:latest
    environment:
      KAFKA_NODE_ID: 1
      KAFKA_PROCESS_ROLES: broker,controller
      KAFKA_LISTENERS: PLAINTEXT://:9092,CONTROLLER://:9093
      KAFKA_ADVERTISED_LISTENERS: PLAINTEXT://broker:9092
      KAFKA_CONTROLLER_LISTENER_NAMES: CONTROLLER
      KAFKA_LISTENER_SECURITY_PROTOCOL_MAP: CONTROLLER:PLAINTEXT,PLAINTEXT:PLAINTEXT
      KAFKA_CONTROLLER_QUORUM_VOTERS: 1@broker:9093
      KAFKA_OFFSETS_TOPIC_REPLICATION_FACTOR: 1
      KAFKA_TRANSACTION_STATE_LOG_REPLICATION_FACTOR: 1
      KAFKA_TRANSACTION_STATE_LOG_MIN_ISR: 1

  pilot:
    image: calinora/pilot:latest
    depends_on: [broker]
    ports: ["8080:8080"]
    environment:
      KAFKA_BOOTSTRAP_SERVERS: broker:9092

Essential Configuration

VariableDefaultDescription
KAFKA_BOOTSTRAP_SERVERSlocalhost:9092Kafka broker addresses (comma-separated)
PORT8080HTTP server port
LOG_LEVELINFOLogging level (DEBUG, INFO, WARN, ERROR)
LICENSE_STRING-JWT license token (unlocks management operations)
KAFKA_SECURITY_PROTOCOLPLAINTEXTPLAINTEXT, SSL, SASL_PLAINTEXT, SASL_SSL

License

Pilot works without a license for all monitoring and read-only operations. A license unlocks management features (reassignments, config changes, maintenance mode, self-healing). Visit calinora.io or email [email protected].

Health Checks

  • Liveness: GET /api/v1/health
  • Readiness: GET /api/v1/ready

Documentation

Full documentation including configuration reference, deployment guides, API reference, and feature guides:

docs.calinora.io


Built with ❤️ by Calinora

Tag summary

Content type

Image

Digest

sha256:099eda45a

Size

13.1 MB

Last updated

12 days ago

docker pull calinora/pilot