openvino/model_server repository overview

⁠Capabilities in the recent tags

⁠Intel® Distribution of OpenVINO™ Model Server Docker image

OpenVINO™ Model Server is a scalable, high-performance solution for serving machine learning models optimized for Intel® architectures. The server provides an inference service via gRPC, REST API or C API -- making it easy to deploy new algorithms and AI experiments.

• GitHub: https://github.com/openvinotoolkit/model_server⁠
• Documentation https://docs.openvino.ai/2026/model-server/ovms_what_is_openvino_model_server.html⁠

The Intel® Distribution of OpenVINO™ toolkit quickly deploys applications and solutions that emulate human vision. Based on Convolutional Neural Networks (CNN), the toolkit extends computer vision (CV) workloads across Intel® hardware, maximizing performance.

• Web-site: https://software.intel.com/en-us/openvino-toolkit⁠
  
• Release Notes: https://github.com/openvinotoolkit/model_server/releases⁠
  
• Documentation: https://docs.openvino.ai⁠
  
• Support forum: https://software.intel.com/en-us/forums/intel-distribution-of-openvino-toolkit⁠
  

To run the image, use the following command:

docker run -it --rm openvino/model_server:latest --help

Start the Docker container with the OpenVINO™ model server and enable just a single model, you do not need any extra configuration file, so this process can be completed with just one command like below:

docker run --rm -d  -v /models/:/opt/ml:ro -p 9001:9001 -p 8001:8001 openvino/model_server:latest --model_path /opt/ml/model1 --model_name my_model --port 9001 --rest_port 8001

Check the Quickstart Guide with classic model⁠ and Quickstart Guide with LLM model⁠

⁠Licenses

LEGAL NOTICE: By accessing, downloading or using this software and any required dependent software (the “Software Package”), you agree to the terms and conditions of the software license agreements for the Software Package, which may also include notices, disclaimers, or license terms for third party software included with the Software Package. Please refer to the “third-party-programs.txt” or other similarly-named text file for additional details.

By downloading and using this container and the included software, you agree to the terms and conditions of the software license agreements located here⁠.

As for any pre-built image usage, it is the image user's responsibility to ensure that any use of this image complies with any relevant licenses and potential fees for all software contained within. We will have no indemnity or warranty coverage from suppliers.

Components:

• Ubuntu: https://hub.docker.com/_/ubuntu⁠
• Intel® Distribution of OpenVINO™ toolkit: https://software.intel.com/en-us/license/eula-for-intel-software-development-products⁠

More Containers for running HPC, AI, ML and etc. workloads can be found at the Intel® oneContainer Portal⁠.