A build from source Triton Inference Server image with utilities. The image is publicly available as hieupth/tritonserver:[version]-[tag].
| Version | Tag | Device | Backend |
|---|---|---|---|
| 25.04 | none | GPU | OnnxRuntime, TensorRT |
| 25.04 | cpu | CPU | OnnxRuntime |
| 25.04 | vllm | GPU | vLLM |
GNU AGPL v3.0
Copyright © 2025 Hieu Pham. All rights reserved.
Content type
Image
Digest
sha256:4892fbdc4…
Size
13.9 GB
Last updated
over 1 year ago
docker pull hieupth/tritonserver:25.04-vllm