samueltallet/alpine-llama-cpp-server:latest

Multi-platform

Machine learning & AI

Web servers

Index digest

sha256:d197b81121a1bcc0b867d30a621421136b9d8aa7414c74aa157ee35d089ef9aa

OS/ARCH

Compressed size

12.79 MB

Last pushed

Type

Image

Manifest digest

sha256:e3b5b4aedb110c0fb1029bca9f0df1ca56464cb2303fc5481dc4a944b6fee158

Image Layers

1ADD alpine-minirootfs-3.21.8-x86_64.tar.gz / # buildkit3.46 MB

2CMD ["/bin/sh"]0 B

3WORKDIR /opt/llama.cpp118 B

4RUN /bin/sh -c apk add1.16 MB

5COPY /opt/llama-server /opt/bigstack.so ./ #8.17 MB

6EXPOSE [8080/tcp]0 B

7ENV LD_PRELOAD=/opt/llama.cpp/bigstack.so0 B

8CMD ["/opt/llama.cpp/llama-server" "--host" "0.0.0.0" "--no-webui"]0 B

Command

ADD alpine-minirootfs-3.21.8-x86_64.tar.gz / # buildkit