sleepsonthefloor/graphpipe-onnx repository overview

⁠graphpipe-onnx - Serve TensorFlow Models via Graphpipe

This is a docker repository that contains builds of the graphpipe-onnx⁠ server, which serves ONNX and Caffe2 models using the GraphPipe protocol.

For more information on GraphPipe, please read our documentation⁠

This repo contains three main builds:

• sleepsonthefloor/graphpipe-onnx:cpu - graphpipe-onnx in Ubuntu compiled with MKL⁠ for cpu inference
• sleepsonthefloor/graphpipe-onnx:oraclelinux-cpu same as the :cpu version, but shipped inside oraclelinux
• sleepsonthefloor/graphpipe-onnx:gpu - graphpipe-onnx in Ubuntu compiled with MKL+CUDA9+cudnn7

You can read more on how to run these servers here⁠.