mlenergy/vllm

•Updated about 2 years ago

vLLM fork with per-token energy measurements

Image

947

Tags for mlenergy/vllm

Sort by

TAG

v0.5.4-openai

Last pushed about 2 years by mlenergy

docker pull mlenergy/vllm:v0.5.4-openai

Digest	OS/ARCH	Compressed size
f765f799b87b	linux/amd64	10.65 GB

TAG

v0.5.4-api

Last pushed about 2 years by mlenergy

docker pull mlenergy/vllm:v0.5.4-api

Digest	OS/ARCH	Compressed size
3b9a35e10a22	linux/amd64	5.22 GB

TAG

v0.4.2-openai

Last pushed over 2 years by mlenergy

docker pull mlenergy/vllm:v0.4.2-openai

Digest	OS/ARCH	Compressed size
c0df18d1de2f	linux/amd64	3.84 GB

TAG

v0.4.2-api

Last pushed over 2 years by mlenergy

docker pull mlenergy/vllm:v0.4.2-api

Digest	OS/ARCH	Compressed size
2d79f16d431b	linux/amd64	3.77 GB