RunPod serverless worker for the vLLM AI text-gen inference. Simple, optimized and customisable.
2.1K
For more information, guide how to setup the Network volume or code to build your own image see https://github.com/davefojtik/RunPod-vLLM
The "dev" tags are only for testing, development and fixes trough github issues. Don't use them in production, as they get removed after the tasks are completed.
Content type
Image
Digest
sha256:c1f3b24ab…
Size
12.7 GB
Last updated
over 1 year ago
docker pull 3wad/runpod-vllm:0.8.5-qwen3-14b-awq