ls250824/comfyui-runtime repository overview

⁠comfyui-runtime

⁠Information

• Docker base image for ComfyUI inference with GPU (CUDA) acceleration.
• This image does not start any services; use ls250824/run-x for that.
• Based on ls250824/pytorch-cuda-ubuntu-runtime⁠.

⁠Websites

• ComfyUI⁠
• comfy-cli⁠
• Code server⁠
• HuggingFace cli⁠
• Flash attention⁠
• Sage attention⁠
• Onnxruntime-gpu⁠
• Triton⁠
• torch_generic_nms⁠
• llama-cpp⁠

⁠Images on Docker

• If the image is less than one day old, it might not be tested yet or might still be updated.

⁠Latest Image Setup

⁠Image

⁠Wheels

⁠Optimised

⁠Build Constraints (/constraints.txt)

numpy<2
onnxruntime-gpu==1.22.*
onnxruntime==0
llama-cpp-python==0.3.16
typer==0.21.1
click==8.*

⁠Adding ComfyUI-Manager Internal Version Instead of Legacy

WORKDIR /ComfyUI
RUN --mount=type=cache,target=/root/.cache/pip \
    python -m pip install --no-cache-dir --root-user-action ignore -c /constraints.txt \
    matrix-nio \
    -r manager_requirements.txt

⁠Docker Speedup

export DOCKER_BUILDKIT=1
export COMPOSE_DOCKER_CLI_BUILD=1