samueltallet/alpine-llama-cpp-server:latest

Multi-platform

Machine learning & AI

Web servers

Index digest

sha256:898345bb2e18ac507fb373118cf0ba8bfe4138d476676be8b7d388a27caa0245

OS/ARCH

Compressed size

12.86 MB

Last pushed

Type

Image

Manifest digest

sha256:271df512330bc6c7dc9a89bb679834d1772c600ec030ffcc1da46bb7ee236e5f

Image Layers

1ADD alpine-minirootfs-3.21.8-x86_64.tar.gz / # buildkit3.46 MB

2CMD ["/bin/sh"]0 B

3WORKDIR /opt/llama.cpp117 B

4RUN /bin/sh -c apk add1.16 MB

5COPY /opt/llama-server /opt/bigstack.so ./ #8.23 MB

6EXPOSE [8080/tcp]0 B

7ENV LD_PRELOAD=/opt/llama.cpp/bigstack.so0 B

8CMD ["/opt/llama.cpp/llama-server" "--host" "0.0.0.0" "--no-webui"]0 B

Command

ADD alpine-minirootfs-3.21.8-x86_64.tar.gz / # buildkit