Sign inSign up

dogkeeper886/ollama37

By dogkeeper886

•Updated 9 days ago

Docker Image for Ollama on NVIDIA K80 GPU

Image
Machine learning & AI
3

10K+

dogkeeper886/ollama37 repository overview

⁠Ollama37 šŸš€

Tesla K80 Compatible Ollama Fork

Run modern LLMs on NVIDIA Tesla K80 and other CUDA Compute Capability 3.7 GPUs. While official Ollama dropped legacy GPU support, Ollama37 keeps your Tesla K80 hardware functional with the latest models and features.

⁠Key Features

  • ⚔ Tesla K80 Support - Full compatibility with CUDA Compute Capability 3.7
  • šŸ› ļø Optimized Build - CUDA 11 toolchain with native CUBIN (~30s cold start)
  • 🧠 Qwen3.5 DeltaNet - First Ollama fork with DeltaNet recurrent architecture support
  • šŸ”§ Tool Calling - Langchain and API tool calling verified

⁠Tested Models

ModelSizeStatus
gemma4:e4b4Bāœ…
gemma4:26b26Bāœ…
gemma3:4b4Bāœ…
gemma3:27b27Bāœ…
qwen3.5:9b9Bāœ…
qwen3.5:27b27Bāœ…
gpt-oss:20b20Bāœ…
ministral-33Bāœ…
functiongemma270Māœ…
deepseek-r1:7b7Bāœ…

šŸŽ„ Demo video: Ollama37 v2.0.3 on Tesla K80⁠

⁠Quick Start

# Pull and run
docker pull dogkeeper886/ollama37:v2.0.3
docker run --runtime=nvidia --gpus all -p 11434:11434 dogkeeper886/ollama37
⁠Docker Compose
version: "3.8"

services:
  ollama:
    image: dogkeeper886/ollama37:latest
    container_name: ollama37
    runtime: nvidia
    deploy:
      resources:
        reservations:
          devices:
            - driver: nvidia
              count: all
              capabilities: [gpu]
    ports:
      - "11434:11434"
    volumes:
      - ollama-data:/root/.ollama
    environment:
      - OLLAMA_HOST=0.0.0.0:11434
      - NVIDIA_VISIBLE_DEVICES=all
      - NVIDIA_DRIVER_CAPABILITIES=compute,utility
    restart: unless-stopped
    healthcheck:
      test: ["CMD", "/usr/local/bin/ollama", "list"]
      interval: 30s
      timeout: 10s
      retries: 3
      start_period: 5s

volumes:
  ollama-data:
    name: ollama-data
docker-compose up -d

⁠Usage

⁠Run Your First Model
# Download and run a model
ollama pull gemma3
ollama run gemma3 "Why is the sky blue?"

# Interactive chat
ollama run gemma3
⁠CLI Commands
ollama list              # List models
ollama show llama3.2     # Model info
ollama ps               # Running models
ollama stop llama3.2    # Stop model
ollama serve            # Start server

⁠Contributing

Found an issue or want to contribute? Check our GitHub issues⁠ or submit Tesla K80-specific bug reports and compatibility fixes.

⁠License

Same license as upstream Ollama. See LICENSE file for details.

Tag summary

Content type

Image

Digest

sha256:10eb85c9f…

Size

539.8 MB

Last updated

9 days ago

docker pull dogkeeper886/ollama37