opea/vllm-cpu-ubi repository overview

⁠vLLM model server for Intel® CPU based on Red Hat® Universal Base image

⁠🔍 Overview

This vLLM Model Server delivers high-performance Large Language Model inference on Intel® CPU using Red Hat® Universal Base image, see vllm-project/vllm⁠.