Sign inSign up

rahulunair/sglang

By rahulunair

•Updated 3 months ago

Intel XPU SGLang LLM and diffusion images

Image
0

744

rahulunair/sglang repository overview

⁠rahulunair/sglang XPU

LLM tags: latest-xpu, 0.5.14-xpu

Diffusion tags: diffusion-latest-xpu, diffusion-0.5.14-xpu

Digests: LLM sha256:b8d89594126e728f1ef329f75ea597c91cee3eb94240da658b3b957b24fb7bc4; diffusion sha256:f25732779f408d4b01292b163f47484d9cf4c025b0ddd1ddcda4554c8171e760.

LLM versions: sglang==0.5.14, sgl-kernel==0.11.0, torch==2.12.0+xpu, triton-xpu==3.7.1, triton==3.7.1.

Diffusion versions: sglang==0.5.14, sgl-kernel==0.11.0, torch==2.12.0+xpu, triton-xpu==3.7.1, triton==3.7.1, diffusers==0.38.0, accelerate==1.14.0.

Note: XPU kernel package is sgl-kernel; there is no separate sglang-xpu-kernels package installed.

Validated 2026-07-02 on 2x Intel Arc Pro B70. LLM passed with /home/rahul/LLM/phi-3-mini-hf, --tp 2, /health 200 and completion 200. Diffusion passed with Tongyi-MAI/Z-Image-Turbo, --num-gpus 2, 2-GPU CFG parallel enabled, /health 200 and /v1/images/generations 200.

Tag summary

Content type

Image

Digest

sha256:f25732779…

Size

8.3 GB

Last updated

3 months ago

docker pull rahulunair/sglang:diffusion-0.5.14-xpu