irfanuruchi/llm-proxy repository overview

llm-proxy is a lightweight, multi-architecture Nginx reverse-proxy image pre-configured (via your nginx.conf) to front your LLM UI and related services. It listens on the port you specify, applies your custom routing rules, and runs in the foreground so Docker can manage it.

Supported platforms: linux/amd64, linux/arm64

Its supposed also to work with the other Docker image for multi node support: https://hub.docker.com/repository/docker/irfanuruchi/distributed-edge-mini-cloud/general⁠

Requests to http://:1234 will be routed according to your nginx.conf.