sandichhuu/llama-cpp

•Updated 5 months ago

Archived

Prebuild for RTX 30xx and newer. Turboquant prebuild from fork of llama-cpp maintained by TheTom.

Image

Machine learning & AI

499

Tags for sandichhuu/llama-cpp

Sort by

TAG

turboquant

Last pushed 5 months by sandichhuu

docker pull sandichhuu/llama-cpp:turboquant

Digest	OS/ARCH	Compressed size
865d7a529a2b	linux/amd64	1.77 GB

TAG

cu132

Last pushed 5 months by sandichhuu

docker pull sandichhuu/llama-cpp:cu132

Digest	OS/ARCH	Compressed size
71d33ec77441	linux/amd64	1.77 GB