Sign inSign up

wasertech/vllm-inference-api

By wasertech

•Updated over 2 years ago

vLLM OpenAI API Endpoint Server for OSS LLMs

Image
1

1.8K

Tags for wasertech/vllm-inference-api

Sort by

TAG

token-stream

Last pushed over 2 years by wasertech

docker pull wasertech/vllm-inference-api:token-stream
DigestOS/ARCHCompressed size

d14e315ca197

linux/amd64

12.66 GB

TAG

v2.0.2-moe

Last pushed over 2 years by wasertech

docker pull wasertech/vllm-inference-api:v2.0.2-moe
DigestOS/ARCHCompressed size

a04dbd12d362

linux/amd64

12.66 GB

TAG

latest

Last pushed over 2 years by wasertech

docker pull wasertech/vllm-inference-api:latest
DigestOS/ARCHCompressed size

a04dbd12d362

linux/amd64

12.66 GB

TAG

v2.0.1-moe

Last pushed over 2 years by wasertech

docker pull wasertech/vllm-inference-api:v2.0.1-moe
DigestOS/ARCHCompressed size

0c5dbe7e5a9f

linux/amd64

10.87 GB