mitakad/open-webui repository overview

Open WebUI⁠ with Ollama⁠

Built on Jetson AGX Orin (SM 87) with Dockerfile⁠

Build command:

ENABLE_DISTRIBUTED_JETSON_NCCL=1 \
PYTORCH_FORCE_BUILD=on \
LSB_RELEASE=24.04 \
CUDA_VERSION=12.9 \
PYTHON_VERSION=3.12 \
PYTORCH_VERSION=2.9.1 \
USE_OLLAMA=on \
jetson-containers build open-webui

• Example run command:
  • Map a persistent directory on the host to /app/backend/data in the container to store database and settings.
  • Other env params can be passed if needed, like OLLAMA_KEEP_ALIVE=15m or OLLAMA_CONTEXT_LENGTH=32000:

jetson-containers run -v /path/to/your/open-webui/persistent/dir:/app/backend/data IMAGE_NAME_GOES_HERE

• After Open WebUI starts, access it via http://<jetson-ip>:8080 in your web browser.