watchdg/exllama-quant

•Updated about 2 months ago

Image

491

Tags for watchdg/exllama-quant

Sort by

TAG

cu12.8-torch2.11.0-py3.12

Last pushed about 2 months by watchdg

docker pull watchdg/exllama-quant:cu12.8-torch2.11.0-py3.12

Digest	OS/ARCH	Compressed size
d13e6e60be9d	linux/amd64	2.36 GB

TAG

cu128-py314

Last pushed about 2 months by watchdg

docker pull watchdg/exllama-quant:cu128-py314

Digest	OS/ARCH	Compressed size
3eae08199302	linux/amd64	119.62 MB

TAG

cu12.8-py3.14

Last pushed about 2 months by watchdg

docker pull watchdg/exllama-quant:cu12.8-py3.14

Digest	OS/ARCH	Compressed size
04c5b2205af0	linux/amd64	119.62 MB