Sign inSign up

meshive/vllm

By meshive

•Updated 12 days ago

vLLM — fast LLM inference with PagedAttention | Meshive GPU Cloud (meshive.ai)

Buildkit cache
Image
0

1.7K

meshive/vllm repository overview

⁠meshive/vllm

vLLM — fast LLM inference with PagedAttention

⁠About Meshive

Meshive is a task-first GPU cloud for AI training, inference, rendering, and serverless model serving. Bring the workload and we run it on RTX 5090 and RTX PRO GPUs at up to 70% less.

Tag summary

Content type

Image

Digest

sha256:9c3e55d51…

Size

8.2 GB

Last updated

12 days ago

docker pull meshive/vllm