Introducing our new CEO Don Johnson - Read More

eisai/ollama

By eisai

Updated 6 minutes ago

ollama for Windows with CUDA support.

Image
Machine Learning & AI
0

687

Only Windows build version 20348 or newer are supported (Win11, Server2022)
Hyper-V or CUDA toolkits are not required

Preparation

Create the following folders, because docker will not automatically create folders for mount on Windows.

ollama
├───models
└───docker-compose.yaml

Docker Compose

networks:
  ollama:

services:
  ollama:
    container_name: ollama
    image: eisai/ollama:latest
    restart: unless-stopped
    isolation: process
    networks:
      - ollama
    cpu_count: 8
    ports:
      - "11434:11434"
    volumes:
      - '.\models:C:\models'
    devices:
      - class/5B45201D-F2F2-4F3B-85BB-30FF1F953599     # Passing GPU, This GUID is fixed

Reference

Ollama Github Repo
https://github.com/ollama/ollama

Open WebUI Repo
https://github.com/open-webui/open-webui

This Image
https://github.com/Eisaichen/ollama-win-docker

Install an ultralight docker engine on Windows
https://eisaichen.com/?p=76

Docker Pull Command

docker pull eisai/ollama