
Entities API is a developer‑native REST layer and SDK for LLM inference, tool calling, code execution, and vector memory — deployable in one container.
Tool = Function Call. Works the same — across all models and vendors out‑of‑the‑box. No drama.
…plus many more (Gemini, GPT‑4, etc.) with progressive status badges in the main GitHub README.
# 1. pull or update the image
docker pull thanosprime/entities-api-api:latest
# 2. run (minimal)
docker run -p 9000:9000 \
-e ENTITIES_SECRET_KEY=change_me \
-e MYSQL_HOST=my-db \
-e QDRANT_URL=http://my-qdrant:6333 \
-e HYPERBOLIC_BASE_URL=https://api.hyperbolic.xyz \
thanosprime/entities-api-api:latest
📝 Swagger / AltRedoc will be live at http://localhost:9000/altredoc.
Need the whole stack? → entities docker‑compose repo.
| 🔹 Feature | What you get in this image |
|---|---|
| Multi‑vendor routing | DeepSeek, Hyperbolic, Together AI, Google Gemini, local Ollama |
| Stateful threads & runs | OpenAI‑style assistant semantics with DB persistence |
| Function‑call = Tool | JSON schema enforcement, automatic dispatch |
| Code interpreter | Safe Python execution in Firejail sandbox |
| Vector memory | Qdrant HTTPx client + custom embeddings |
| Security first | Subprocess isolation, no implicit network escapes |
curl -X POST http://localhost:9000/v1/threads/THREAD_ID/messages \
-H "Authorization: Bearer $API_KEY" \
-d '{"role":"user","content":"Hello"}'
Stream completions with:
curl -N http://localhost:9000/v1/threads/THREAD_ID/runs/RUN_ID/stream \
-H "Authorization: Bearer $API_KEY"
Full endpoints documented in /altredoc.
pip install projectdavid
Gives you
MessagesClient,RunsClient, and helper wrappers for streaming.
Docs ➜ https://github.com/frankie336/projectdavid
| Hyperbolic | DeepSeek | Together AI | Google (Gemini/Gemma) | Ollama (local) | OpenAI* | Anthropic* |
|---|
*road‑map / partial
Released under PolyForm Noncommercial 1.0.0.
Commercial licensing available — drop a line in the GitHub repo.
Deploy the API container. Wire in your keys. Ship intelligence.
That’s it — Entities keeps the rest out of your way.
Content type
Image
Digest
sha256:7e6c966bb…
Size
4.8 GB
Last updated
7 months ago
docker pull thanosprime/entities-api-api