x3huang/slm_server

•Updated 7 months ago

Light model server that serves small language models using `llama-cpp` via `/chat/completions` API.

Buildkit cache

Image

2.9K

x3huang/slm_server repository overview

No overview available

This repository doesn't have an overview

Recent tags

Content type

Image

Digest

sha256:8999f9233…

Size

476.1 MB

Last updated

7 months ago

docker pull x3huang/slm_server