degirum/dg_local_compiler repository overview

⁠About This Repo

Detailed documentation is provided here⁠.

This is the official Docker compiler image for compiling YOLOv5 and YOLOv8 checkpoints, as well as any other model architectures starting from .onnx or .tflite files, into models supported by DeGirum's N2X-ORCA1, OPENVINO (CPU / GPU / NPU), TFLITE (CPU / EDGETPU), TENSORRT-GPU, RKNN (RK3566 / RK3568 / RK3576 / RK3588), HAILORT (HAILO8 / HAILO8L), MEMRYX-MX3, AXELERA-METIS, and DEEPX-M1A frameworks. Once the container is running, the Streamlit UI is served on port 8501 and the compile REST API on port 8535.

⁠Quick start

⁠Prerequisites

• Docker Engine 20.10+ (Linux) or Docker Desktop 4.x+ (macOS / Windows + WSL2).
• ~15 GB free disk for the image.
• A host folder where compiled model zips will be written.

⁠1. (Optional) Pre-pull the image

Useful on slow networks or when you want to separate download from startup.

docker pull degirum/dg_local_compiler:latest

⁠2. Create a zoo folder

This folder will receive the compiled model zips.

mkdir -p ~/dg_zoo

⁠3. Run the compiler

docker run --rm --privileged \
    -p 8501:8501 -p 8535:8535 \
    --mount type=bind,source=$HOME/dg_zoo,target=/output_files \
    degirum/dg_local_compiler:latest

Windows PowerShell equivalent:

docker run --rm --privileged `
    -p 8501:8501 -p 8535:8535 `
    --mount type=bind,source=$HOME\dg_zoo,target=/output_files `
    degirum/dg_local_compiler:latest

⁠4. Use it

• Web UI: http://localhost:8501⁠
• REST API: http://localhost:8535⁠ (/ir_compile, /yolocompile, /get-device-list)

Compiled .zip bundles appear in the host zoo folder (~/dg_zoo) and are ready for local inference or upload to the DeGirum cloud portal.

⁠5. Stop

Press Ctrl+C in the terminal running docker run. Because of --rm, the container is removed automatically on exit; your compiled zips in the bind-mounted folder are kept.

⁠6. Update to a new release

docker pull degirum/dg_local_compiler:latest
# then re-run step 3