Sign inSign up

ascendai/triton

By ascendai

•Updated 10 days ago

Image
0

100K+

ascendai/triton repository overview

⁠Triton compilation framework Triton-Ascend

⁠Quick Reference


⁠Triton-Ascend

Triton-Ascend is a Triton compilation framework built for the Ascend platform, aiming to enable Triton code to run efficiently on Ascend hardware. For details, see Triton-Ascend⁠.

⁠Supported Tags and Dockerfile

⁠Tag specifications

Tag follow the following format:
{triton-ascend version}-{CANN version}-{torch_npu version}-{applicable product}-{os version}-{python version}

FieldExample Value
triton-ascend version3.2.2
CANN versioncann9.0.0, cann9.1.0
torch_npu versiontorch_npu2.7.1.post8
applicable product910b, a3, 950
os versionubuntu24.04, openeuler24.03
python versionpy3.11

⁠Triton-Ascend Images

⁠Release 3.2.2
⁠Key Image Components
ComponentsVersion
Triton-Ascend3.2.2
CANN9.1.0
Torch-NPU2.7.1.post8
⁠Image List
TagDockerfileDocker Pull Command
3.2.2-cann9.1.0-torch_npu2.7.1.post8-910b-debian12-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-910b-debian12-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-910b-ubuntu24.04-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-910b-ubuntu24.04-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-910b-openeuler24.03-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-910b-openeuler24.03-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-debian12-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-debian12-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-ubuntu24.04-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-ubuntu24.04-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-openeuler24.03-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-openeuler24.03-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-950-debian12-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-950-debian12-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-950-ubuntu24.04-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-950-ubuntu24.04-py3.11
3.2.2-cann9.1.0-torch_npu2.7.1.post8-950-openeuler24.03-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-950-openeuler24.03-py3.11
⁠Release 3.2.1
⁠Key Image Components
ComponentsVersion
Triton-Ascend3.2.1
CANN9.0.0
Torch-NPU2.7.1.post4
⁠Image List
TagDockerfileDocker Pull Command
3.2.1-cann9.0.0-torch_npu2.7.1.post4-910b-debian12-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-910b-debian12-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-910b-ubuntu22.04-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-910b-ubuntu22.04-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-910b-openeuler24.03-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-910b-openeuler24.03-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-a3-debian12-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-a3-debian12-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-a3-ubuntu22.04-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-a3-ubuntu22.04-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-a3-openeuler24.03-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-a3-openeuler24.03-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-950-debian12-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-950-debian12-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-950-ubuntu22.04-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-950-ubuntu22.04-py3.11
3.2.1-cann9.0.0-torch_npu2.7.1.post4-950-openeuler24.03-py3.11Dockerfile⁠docker pull quay.io/ascend/triton:3.2.1-cann9.0.0-torch_npu2.7.1.post4-950-openeuler24.03-py3.11

⁠Quick Start

⁠Running the Triton-Ascend Container

# Assume that your NPU device model is A3, the device is installed in /dev/davinci1, and the NPU driver is installed in /usr/local/Ascend:
docker run -u 0 -dit --shm-size=512g --name=triton-ascend_container \
--security-opt seccomp=unconfined \
--device=/dev/davinci0 \
--device=/dev/davinci1 \
--device=/dev/davinci2 \
--device=/dev/davinci3 \
--device=/dev/davinci4 \
--device=/dev/davinci5 \
--device=/dev/davinci6 \
--device=/dev/davinci7 \
--device=/dev/davinci_manager \
--device=/dev/devmm_svm \
--device=/dev/hisi_hdc \
-v /usr/local/dcmi:/usr/local/dcmi \
-v /usr/local/bin/npu-smi:/usr/local/bin/npu-smi \
-v /usr/local/sbin/npu-smi:/usr/local/sbin/npu-smi \
-v /usr/local/Ascend/driver:/usr/local/Ascend/driver \
-v /etc/ascend_install.info:/etc/ascend_install.info \
-v /home:/home \
quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-ubuntu24.04-py3.11 \
/bin/bash

⁠How to Build Locally?

arm64

docker build \
--network host \
--build-arg TARGETPLATFORM=linux/arm64 \
-t triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-ubuntun22.04-py3.11-aarch64 \
-f Dockerfile .

amd64

docker build \
--network host \
--build-arg TARGETPLATFORM=linux/amd64 \
-t triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-ubuntun22.04-py3.11-x86_64 \
-f Dockerfile .

⁠How to Perform Secondary Development?

# Using the triton-ascend image as the base image and adding user software to it.
FROM quay.io/ascend/triton:3.2.2-cann9.1.0-torch_npu2.7.1.post8-a3-ubuntu24.04-py3.11
RUN apt update -y && \
    apt install wget \
    ...

⁠Supported hardware

Chip SeriesProduct ExampleArchitecture
Ascend 910bAtlas 800T A2, Atlas 900 A2 PoDarm64, amd64
Ascend A3Atlas 800T A3arm64, amd64
Ascend 950950PR Seriesarm64, amd64

⁠License

View the license information of the CANN, Torch-NPU and Triton-Ascend software contained in the image. For details, visit License⁠.
As with all container images, the pre-installed software packages (such as Python and system libraries) may be subject to their own licenses.

Tag summary

Content type

Image

Digest

sha256:629d9c613…

Size

4.9 GB

Last updated

10 days ago

docker pull ascendai/triton:9.2.0-beta.1-a3-ubuntu22.04-py3.11-latest-arm64