Self-hosted LLM gateway with multi-provider routing, budgets, web dashboard, and CLI.
10K+
One gateway. Any AI model. Total control.
Routerly is the self-hosted decision and control layer for your LLM providers. It sits between your applications and OpenAI, Anthropic, Google Gemini, Ollama and more. It decides which model serves each request through composable routing policies with explainable decisions, and it controls who may send what through roles, permissions, budgets, guardrails and audit.
Wire-format transparent. Change the base URL in your OpenAI or Anthropic client, nothing else. Routerly adds no custom headers and no non-standard fields, and returns the provider's response as received. Payloads change only for features you switch on yourself (PII scrubbing, guardrail steering, token optimizers).
Your App ──────────────────────▶ Routerly ──▶ OpenAI / Anthropic
│ ──▶ AWS Bedrock
POST /v1/chat/completions │ ──▶ Azure OpenAI
(same API, any SDK) │ ──▶ Google Vertex AI
│ ──▶ Gemini / Mistral / Groq / Cohere
│ ──▶ Ollama (local)
Auth · Route · Budget · Track
docker run -d \
--name routerly \
-p 3000:3000 \
-v routerly_data:/data \
-e ROUTERLY_HOME=/data \
--restart unless-stopped \
inebrio/routerly:latest
Open http://localhost:3000/dashboard, create the admin account and add your first model.
services:
routerly:
image: inebrio/routerly:latest
ports:
- "3000:3000"
volumes:
- routerly_data:/data
environment:
- ROUTERLY_HOME=/data
restart: unless-stopped
volumes:
routerly_data:
llm, semantic-intent, model-preference, cheapest, health, performance, capability, context, budget-remaining, rate-limit, fairness) combined into one ranking, plus reusable routing profiles. Automatic fallback if a provider fails.Cursor, Open WebUI, LibreChat, LangChain, LlamaIndex or plain curl: anything that speaks the OpenAI or Anthropic protocol works without modification (/v1/chat/completions, /v1/responses, /v1/messages).
client = OpenAI(
base_url="http://localhost:3000/v1",
api_key="your-router-token"
)
All data and configuration are stored in /data inside the container. Mount a volume there to persist settings across restarts.
| Variable | Default | Description |
|---|---|---|
ROUTERLY_HOME | /data | Data directory |
ROUTERLY_PORT | 3000 | HTTP port |
NODE_ENV | production | Node environment |
linux/amd64linux/arm64 (Apple Silicon, AWS Graviton, Raspberry Pi)| Tag | Description |
|---|---|
latest | Latest stable release |
vX.Y.Z | Specific version |
develop | Latest develop build (pre-release) |
Content type
Image
Digest
sha256:5ccc57655…
Size
537.2 MB
Last updated
17 days ago
docker pull inebrio/routerly