zipnn/vllm-openai

•Updated over 1 year ago

building on top of vllm/vllm-openai, adding zipnn model loading support.

Image

1.5K

zipnn/vllm-openai repository overview

No overview available

This repository doesn't have an overview

Recent tags

Content type

Image

Digest

sha256:67852ec21…

Size

8.3 GB

Last updated

over 1 year ago

docker pull zipnn/vllm-openai