Lightweight control plane for llama.cpp: source builds, models.ini presets & GGUF model management.
444
This repository (vm75/llama-web-ui) is deprecated and will no longer receive updates.
The project has been renamed to llama-controller to better reflect its function as a lightweight control plane for llama.cpp and llama-server.
vm75/llama-controllergithub.com/vm75/llama-controllerExisting volumes (./data) and configurations are 100% compatible. Simply update your container name and image tag.
Change your pull/run command from vm75/llama-web-ui to vm75/llama-controller:
docker run -d \
--name llama-controller \
-p 5000:5000 \
-p 8080:8080 \
-v ./data:/home/llama/app/data:Z \
vm75/llama-controller:latest
Update image: in your docker-compose.yml:
services:
llama-controller:
image: vm75/llama-controller:latest
container_name: llama-controller
ports:
- "${LLAMA_CONTROLLER_PORT:-5000}:5000"
- "${LLAMA_SERVER_PORT:-8080}:8080"
environment:
- LLAMA_CONTROLLER_PORT=${LLAMA_CONTROLLER_PORT:-5000}
- LLAMA_SERVER_PORT=${LLAMA_SERVER_PORT:-8080}
- LLAMA_CPP_REPO=${LLAMA_CPP_REPO:-https://github.com/ggml-org/llama.cpp.git}
- LLAMA_CPP_BRANCH=${LLAMA_CPP_BRANCH:-master}
volumes:
- ./data:/home/llama/app/data:Z
restart: unless-stopped
userns_mode: keep-id
Please pull images from vm75/llama-controller moving forward.
Content type
Image
Digest
sha256:4ab64dfbd…
Size
231.9 MB
Last updated
about 2 months ago
docker pull vm75/llama-web-ui