autodeployai/ai-serving-cuda repository overview

⁠AI-Serving

Serving AI/ML models in the open standard formats PMML and ONNX with both HTTP (REST API) and gRPC endpoints

⁠Tags

Minimal image with AI-Serving binary installed with the default CUDA GPUs backend of ONNXRuntime and ready to serve PMML and ONNX.

⁠Home

https://github.com/autodeployai/ai-serving⁠