callakrsos/tei-bge-m3 repository overview

⁠callakrsos/tei-bge-m3

Self-contained Text Embeddings Inference image for BAAI/bge-m3.

This repository provides prebuilt container images that include the model files inside the image, so the container can run without downloading from Hugging Face at startup.

⁠Tags

• callakrsos/tei-bge-m3:cpu
• callakrsos/tei-bge-m3:gpu

⁠Features

• BAAI/bge-m3 model baked into the image
• HF_HUB_OFFLINE=1 enabled for offline runtime behavior
• Separate CPU and GPU tags
• Verified startup on Podman

⁠Run

CPU:

podman run --rm -p 8080:80 callakrsos/tei-bge-m3:cpu

GPU:

podman run --rm -p 8081:80 --device nvidia.com/gpu=all callakrsos/tei-bge-m3:gpu

⁠Notes

• The GPU image expects NVIDIA GPU access through the container runtime.
• On Windows + Podman machine + WSL2, GPU access was validated with CDI device injection using --device nvidia.com/gpu=all.
• The CPU and GPU variants can consume substantial memory during warm-up. Avoid running both at the same time on a small Podman machine.
• First startup may take a few minutes while the model warms up.

⁠Base Images

• CPU: ghcr.io/huggingface/text-embeddings-inference:cpu-ipex-latest
• GPU: ghcr.io/huggingface/text-embeddings-inference:cuda-1.9

⁠Source Notes

This image was built from Hugging Face Text Embeddings Inference with a local copy of BAAI/bge-m3 added to the container image.

https://github.com/zaruous/bge-m3-full-dockerhub⁠