Sign inSign up

3wad/runpod-vllm

By 3wad

Updated over 1 year ago

RunPod serverless worker for the vLLM AI text-gen inference. Simple, optimized and customisable.

Image
Integration & delivery
Machine learning & AI
1

2.1K

3wad/runpod-vllm repository overview

For more information, guide how to setup the Network volume or code to build your own image see https://github.com/davefojtik/RunPod-vLLM

The "dev" tags are only for testing, development and fixes trough github issues. Don't use them in production, as they get removed after the tasks are completed.

Tag summary

Content type

Image

Digest

sha256:c1f3b24ab

Size

12.7 GB

Last updated

over 1 year ago

docker pull 3wad/runpod-vllm:0.8.5-qwen3-14b-awq