fkdosilovic/vllm-arm repository overview

⁠vLLM for ARM architecture

⁠Build

1. Clone the vLLM repo:

   git clone https://github.com/vllm-project/vllm.git
   

   Copy

2. Position the terminal to vllm folder, fetch the tags, and checkout to the version of choice:

   cd vllm
   git fetch --all
   git checkout tags/v0.7.3
   

   Copy

3. Build the docker image

   docker build -f Dockerfile.arm -t vllm-arm:v0.7.3 --shm-size=4g .
   

   Copy