evilfreelancer/llama.cpp-rpc

By evilfreelancer

•Updated about 5 hours ago

Dockerized llama.cpp RPC-server

Image

Machine learning & AI

50K+

Overview Tags

Tags for evilfreelancer/llama.cpp-rpc

Sort by

TAG

latest-cuda

Last pushed about 5 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:latest-cuda

Digest	OS/ARCH	Compressed size
01759001286f	linux/amd64	1.77 GB

TAG

cuda

Last pushed about 5 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:cuda

Digest	OS/ARCH	Compressed size
01759001286f	linux/amd64	1.77 GB

TAG

b12032-cuda

Last pushed about 5 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b12032-cuda

Digest	OS/ARCH	Compressed size
01759001286f	linux/amd64	1.77 GB

TAG

b12031-cuda

Last pushed about 5 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b12031-cuda

Digest	OS/ARCH	Compressed size
8afe2579ea20	linux/amd64	1.77 GB

TAG

b12031

Last pushed about 6 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b12031

Digest	OS/ARCH	Compressed size
d2981cdfc09a	linux/amd64	104 MB
87ab7f25fca8	linux/arm64	90.78 MB

TAG

latest

Last pushed about 6 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:latest

Digest	OS/ARCH	Compressed size
ea9c0224c594	linux/amd64	104 MB
17044b85725d	linux/arm64	90.78 MB

TAG

b12032

Last pushed about 6 hours by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b12032

Digest	OS/ARCH	Compressed size
ea9c0224c594	linux/amd64	104 MB
17044b85725d	linux/arm64	90.78 MB

TAG

b11871-cuda

Last pushed 7 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11871-cuda

Digest	OS/ARCH	Compressed size
1b4607b30fe5	linux/amd64	1.76 GB

TAG

b11870-cuda

Last pushed 7 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11870-cuda

Digest	OS/ARCH	Compressed size
4bf632cbf41b	linux/amd64	1.76 GB

TAG

b11870

Last pushed 7 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11870

Digest	OS/ARCH	Compressed size
ff06292cc56b	linux/amd64	103.1 MB
0ea1de516260	linux/arm64	90.17 MB

TAG

b11871

Last pushed 7 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11871

Digest	OS/ARCH	Compressed size
9ac7623ae32b	linux/amd64	103.13 MB
5e3c00a88d6e	linux/arm64	90.19 MB

TAG

b11718-cuda

Last pushed 14 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11718-cuda

Digest	OS/ARCH	Compressed size
4ddec7e0c29e	linux/amd64	1.76 GB

TAG

b11717-cuda

Last pushed 14 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11717-cuda

Digest	OS/ARCH	Compressed size
64c4efd982b2	linux/amd64	1.76 GB

TAG

b11717

Last pushed 14 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11717

Digest	OS/ARCH	Compressed size
b30e354cd43c	linux/amd64	102.56 MB
ae10d1f0ff62	linux/arm64	89.73 MB

TAG

b11718

Last pushed 14 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11718

Digest	OS/ARCH	Compressed size
b8709e34a0f7	linux/amd64	102.56 MB
ef45998498bc	linux/arm64	89.73 MB

TAG

b11553-cuda

Last pushed 21 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11553-cuda

Digest	OS/ARCH	Compressed size
1b7dc1b8ea1b	linux/amd64	1.75 GB

TAG

b11552-cuda

Last pushed 21 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11552-cuda

Digest	OS/ARCH	Compressed size
2e314ad018bb	linux/amd64	1.75 GB

TAG

b11387-cuda

Last pushed 28 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11387-cuda

Digest	OS/ARCH	Compressed size
f6d06823f5ec	linux/amd64	1.75 GB

TAG

b11388-cuda

Last pushed 28 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11388-cuda

Digest	OS/ARCH	Compressed size
766b6f851033	linux/amd64	1.75 GB

TAG

b11387

Last pushed 28 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11387

Digest	OS/ARCH	Compressed size
8c86e9b963ac	linux/amd64	104.27 MB
eddf2aaf5a74	linux/arm64	90.57 MB

TAG

b11388

Last pushed 28 days by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11388

Digest	OS/ARCH	Compressed size
0cc3f4264749	linux/amd64	104.28 MB
df2ef6c7d3de	linux/arm64	90.58 MB

TAG

b11211-cuda

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11211-cuda

Digest	OS/ARCH	Compressed size
e7b73c0a72ca	linux/amd64	1.75 GB

TAG

b11209-cuda

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11209-cuda

Digest	OS/ARCH	Compressed size
cc68571d8058	linux/amd64	1.75 GB

TAG

b11209

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11209

Digest	OS/ARCH	Compressed size
b012cdaef320	linux/amd64	101.33 MB
e2534a1421b7	linux/arm64	87.77 MB

TAG

b11211

Last pushed about 1 month by evilfreelancer

docker pull evilfreelancer/llama.cpp-rpc:b11211

Digest	OS/ARCH	Compressed size
062e9018ad88	linux/amd64	101.33 MB
f8585a0cba75	linux/arm64	87.77 MB