helmuthva/jetson-xavier-tensorflow-serving repository overview

TensorFlow Serving accelerated by GPU/CUDA running on NVIDIA Jetson AGX Xavier with Python/Fast API based webservice for predictions.

Works with JetPack 4.2.1 and default Docker runtime.

TensorFlow Serving and webservice managed by supervisord.

See https://github.com/helmuthva/jetson/tree/master/workflow/deploy/tensorflow-serving⁠ and https://github.com/helmuthva/jetson⁠ for details including Kubernetes deployments using this image as base.