eisai/ollama
ollama for Windows with CUDA support.
687
Only Windows build version 20348 or newer are supported (Win11, Server2022)
Hyper-V or CUDA toolkits are not required
Create the following folders, because docker will not automatically create folders for mount on Windows.
ollama
├───models
└───docker-compose.yaml
networks:
ollama:
services:
ollama:
container_name: ollama
image: eisai/ollama:latest
restart: unless-stopped
isolation: process
networks:
- ollama
cpu_count: 8
ports:
- "11434:11434"
volumes:
- '.\models:C:\models'
devices:
- class/5B45201D-F2F2-4F3B-85BB-30FF1F953599 # Passing GPU, This GUID is fixed
Ollama Github Repo
https://github.com/ollama/ollama
Open WebUI Repo
https://github.com/open-webui/open-webui
This Image
https://github.com/Eisaichen/ollama-win-docker
Install an ultralight docker engine on Windows
https://eisaichen.com/?p=76
docker pull eisai/ollama