OpenNMT

Fast inference engine for Transformer models

TensorFlow Serving images with Addons>GatherTree op (deprecated)

Open Source Neural Machine Translation in Torch