Sign inSign up

thanosprime/entities-api-api

By thanosprime

•Updated 7 months ago

Image
0

3.8K

thanosprime/entities-api-api repository overview

⁠Entities API v1 — Docker Edition 🐳

Docker Pulls Docker Version CI

Entities Emblem

Entities API is a developer‑native REST layer and SDK for LLM inference, tool calling, code execution, and vector memory — deployable in one container.

⁠💎 Universal Tool Use

Tool = Function Call. Works the same — across all models and vendors out‑of‑the‑box. No drama.


⁠✅ Ready‑to‑Roll Models (highlights)

DeepSeek-V3 DeepSeek-R1 DeepSeek-R1-Distill-Qwen-14B

LLaMA-3.3 LLaMA-3.2-90B-Vision-Turbo LLaMA-Guard-2-8B

Qwen-QwQ-32B Qwen2.5-Coder-32B

Gemma-2-9B-IT

Mistral-7B-v0.3

…plus many more (Gemini, GPT‑4, etc.) with progressive status badges in the main GitHub README.


⁠Quick Start (single container)

# 1. pull or update the image
docker pull thanosprime/entities-api-api:latest

# 2. run (minimal)
docker run -p 9000:9000 \
  -e ENTITIES_SECRET_KEY=change_me \
  -e MYSQL_HOST=my-db \
  -e QDRANT_URL=http://my-qdrant:6333 \
  -e HYPERBOLIC_BASE_URL=https://api.hyperbolic.xyz \
  thanosprime/entities-api-api:latest

📝 Swagger / AltRedoc will be live at http://localhost:9000/altredoc.

Need the whole stack? → entities⁠ docker‑compose repo.


⁠Why pick Entities API Container?

🔹 FeatureWhat you get in this image
Multi‑vendor routingDeepSeek, Hyperbolic, Together AI, Google Gemini, local Ollama
Stateful threads & runsOpenAI‑style assistant semantics with DB persistence
Function‑call = ToolJSON schema enforcement, automatic dispatch
Code interpreterSafe Python execution in Firejail sandbox
Vector memoryQdrant HTTPx client + custom embeddings
Security firstSubprocess isolation, no implicit network escapes

⁠Minimal Curl Example

curl -X POST http://localhost:9000/v1/threads/THREAD_ID/messages \
     -H "Authorization: Bearer $API_KEY" \
     -d '{"role":"user","content":"Hello"}'

Stream completions with:

curl -N http://localhost:9000/v1/threads/THREAD_ID/runs/RUN_ID/stream \
     -H "Authorization: Bearer $API_KEY"

Full endpoints documented in /altredoc.


⁠Install the Python SDK (client‑side)

pip install projectdavid

Gives you MessagesClient, RunsClient, and helper wrappers for streaming.

Docs ➜ https://github.com/frankie336/projectdavid⁠


⁠Supported Providers

HyperbolicDeepSeekTogether AIGoogle (Gemini/Gemma)Ollama (local)OpenAI*Anthropic*

*road‑map / partial


⁠License

Released under PolyForm Noncommercial 1.0.0.
Commercial licensing available — drop a line in the GitHub repo.


Deploy the API container. Wire in your keys. Ship intelligence.
That’s it — Entities keeps the rest out of your way.

Tag summary

Content type

Image

Digest

sha256:7e6c966bb…

Size

4.8 GB

Last updated

7 months ago

docker pull thanosprime/entities-api-api