samueltallet/alpine-llama-cpp-server:latest

Multi-platform

Machine learning & AI

Web servers

Index digest

sha256:971cf26cdbf4cc51edeeeb41b7e533f8bca32d07e9177b3dd782c298b7db8ce4

OS/ARCH

Compressed size

13.61 MB

Last pushed

Type

Image

Manifest digest

sha256:82b98b7a0f6e0c061354872cf7975ed68e0124a1a93d5b4307bad7d895f4d664

Image Layers

1ADD alpine-minirootfs-3.21.9-x86_64.tar.gz / # buildkit3.46 MB

2CMD ["/bin/sh"]0 B

3WORKDIR /opt/llama.cpp117 B

4RUN /bin/sh -c apk add1.16 MB

5COPY /opt/llama-server /opt/bigstack.so ./ #8.98 MB

6EXPOSE [8080/tcp]0 B

7ENV LD_PRELOAD=/opt/llama.cpp/bigstack.so0 B

8CMD ["/opt/llama.cpp/llama-server" "--host" "0.0.0.0" "--no-webui"]0 B

Command

ADD alpine-minirootfs-3.21.9-x86_64.tar.gz / # buildkit