kinesiscloud/kinesis-vllm

•Updated 10 months ago

Wrapper around vllm/vllm-openai that does auto-idle and awake for resource efficiency

Image

2.2K

kinesiscloud/kinesis-vllm repository overview

No overview available

This repository doesn't have an overview

Recent tags

Content type

Image

Digest

sha256:a0d564f5f…

Size

13.1 GB

Last updated

10 months ago

docker pull kinesiscloud/kinesis-vllm