Onnxruntime images for the Jetson Xavier and AGX Xavier.
53
This image is intended to serve as a base image for Onnxruntime on the Jetson Xavier and AGX Xavier. It assumes Cuda 12.2 with the Cuda compatibility is available on the host. The Cuda compatibility is required to allow the older Jetson devices to work with Onnxruntime versions that require Cuda 12.8+ and cuDNN 9.x.
The Jetson Linux v35.6.5 (JetPack 5.1.5 equivalent tier) was the last version of Jetpack released for the older Jetson devices. It is capable of running Cuda 12.2 but does not ship with it.
First check you are on JetPack 5.1.5. Jetpack may still see a 5.1.x patch fix but it is the highest version of Jetpack the device can run.
cat /etc/nv_tegra_release
# R35 (release), REVISION: 6.5, GCID: 46196569, BOARD: t186ref, EABI: aarch64, DATE: Wed Jul 1 09:42:50 UTC 2026
Add the nvidia repository
wget https://developer.download.nvidia.com/compute/cuda/12.2.0/local_installers/cuda-tegra-repo-ubuntu2004-12-2-local_12.2.0-1_arm64.deb
sudo dpkg -i cuda-tegra-repo-ubuntu2004-12-2-local_12.2.0-1_arm64.deb
sudo cp /var/cuda-tegra-repo-ubuntu2004-12-2-local/cuda-*-keyring.gpg /usr/share/keyrings/
sudo apt-get update
Install cuda-toolkit-12-2 and cuda-compat-12-2.
sudo apt-get install -y cuda-toolkit-12-2 cuda-compat-12-2
Then ensure the installation is on your PATH and available to the linker.
echo 'export PATH=/usr/local/cuda-12.2/bin:$PATH' >> ~/.bashrc
echo 'export LD_LIBRARY_PATH=/usr/local/cuda-12.2/compat:/usr/local/cuda-12.2/lib64:$LD_LIBRARY_PATH' >> ~/.bashrc
source ~/.bashrc
Run nvcc --version to verify. It should report cuda 12.2.
toor@xavier:~$ nvcc --version
nvcc: NVIDIA (R) Cuda compiler driver
Copyright (c) 2005-2023 NVIDIA Corporation
Built on Tue_Jun_13_19:22:54_PDT_2023
Cuda compilation tools, release 12.2, V12.2.91
Build cuda_12.2.r12.2/compiler.32965470_0
Content type
Image
Digest
sha256:63f061274…
Size
1.2 GB
Last updated
1 day ago
docker pull androiddrew/onnxruntime-jetson-xavier:1.22.2-cuda-12.2-cudnn-9.3