you can use tensorflow serving to serving all your saved models on the prepared dataset