uberchuckie/ollama-intel-gpu

By uberchuckie

Updated 6 days ago

Ollama images for running on Intel GPUs.

Image
0

266

Ollama images for running on Intel GPUs.

Images built from https://github.com/charlescng/ollama-intel-gpu which is a fork of https://github.com/mattcurf/ollama-intel-gpu. It's essentially a thin wrapper of https://hub.docker.com/r/intelanalytics/ipex-llm-inference-cpp-xpu.

I have success running the image with an Intel Arc A380 with the following environment variables:

  • DEVICE=Arc
  • OLLAMA_MAX_LOADED_MODELS=1
  • OLLAMA_NUM_PARALLEL=1
  • OLLAMA_NUM_GPU=1
  • SYCL_CACHE_PERSITENT=1

Docker Pull Command

docker pull uberchuckie/ollama-intel-gpu