rlmsinclair/qwen-vllm

•Updated over 1 year ago

Deploy Qwen 2.5 coder 8 bit quantized with VLLM on 4 3090s

Image

10K+

rlmsinclair/qwen-vllm repository overview

No overview available

This repository doesn't have an overview

Recent tags

Content type

Image

Digest

sha256:af73dbedf…

Size

9.8 GB

Last updated

over 1 year ago

docker pull rlmsinclair/qwen-vllm