darren2046/llama-http-server

•Updated over 3 years ago

Image

978

Tags for darren2046/llama-http-server

Sort by

TAG

nvidia-opencl

Last pushed over 3 years by darren2046

docker pull darren2046/llama-http-server:nvidia-opencl

Digest	OS/ARCH	Compressed size
2b3c1d9875b0	linux/amd64	802.98 MB
00e6f3687e5c	linux/arm64	723.25 MB

TAG

openllama-7b-v5-q3_K

Last pushed over 3 years by darren2046

docker pull darren2046/llama-http-server:openllama-7b-v5-q3_K

Digest	OS/ARCH	Compressed size
10ce1dda1e53	linux/amd64	4.27 GB
3ee33a94f307	linux/arm64	4.15 GB

TAG

openllama-7b-v5-q5_K

Last pushed over 3 years by darren2046

docker pull darren2046/llama-http-server:openllama-7b-v5-q5_K

Digest	OS/ARCH	Compressed size
7a31d4b44b75	linux/amd64	5.74 GB
4d6f88dd77fc	linux/arm64	5.61 GB

TAG

openbubby-13b-v7-q4_K

Last pushed over 3 years by darren2046

docker pull darren2046/llama-http-server:openbubby-13b-v7-q4_K

Digest	OS/ARCH	Compressed size
58bf24b6f3d5	linux/amd64	8.51 GB
69f12423bbde	linux/arm64	8.39 GB

TAG

latest

Last pushed over 3 years by darren2046

docker pull darren2046/llama-http-server:latest

Digest	OS/ARCH	Compressed size
d1251547a11b	linux/amd64	1.27 GB
f660a9785f38	linux/arm64	1.14 GB