Sentence embedding API. Any HuggingFace model via env var. CPU + GPU.
1.2K
Sentence embedding server. Any HuggingFace model via env var. Normalized vectors out.
| Tag | Hardware | Base |
|---|---|---|
latest | CPU | python:3.11-slim-bookworm |
gpu | NVIDIA CUDA 12.4 | nvidia/cuda:12.4.1-base-ubuntu22.04 |
CPU
services:
embedding-api:
image: xeze/embedding-api:latest
environment:
- EMBEDDING_MODEL_NAME=${EMBEDDING_MODEL_NAME}
ports:
- "8000:8000"
volumes:
- hf-cache:/root/.cache/huggingface
volumes:
hf-cache:
GPU
services:
embedding-api:
image: xeze/embedding-api:gpu
environment:
- EMBEDDING_MODEL_NAME=${EMBEDDING_MODEL_NAME}
ports:
- "8000:8000"
volumes:
- hf-cache:/root/.cache/huggingface
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: 1
capabilities: [gpu]
volumes:
hf-cache:
# .env
EMBEDDING_MODEL_NAME=BAAI/bge-small-en-v1.5
EMBEDDING_MODEL_NAME is required — container exits immediately if not setContent type
Image
Digest
sha256:3dc563637…
Size
405.4 MB
Last updated
3 months ago
docker pull xeze/embedding-api