Docker Image for Ollama on NVIDIA K80 GPU
10K+
Tesla K80 Compatible Ollama Fork
Run modern LLMs on NVIDIA Tesla K80 and other CUDA Compute Capability 3.7 GPUs. While official Ollama dropped legacy GPU support, Ollama37 keeps your Tesla K80 hardware functional with the latest models and features.
| Model | Size | Status |
|---|---|---|
| gemma4:e4b | 4B | ā |
| gemma4:26b | 26B | ā |
| gemma3:4b | 4B | ā |
| gemma3:27b | 27B | ā |
| qwen3.5:9b | 9B | ā |
| qwen3.5:27b | 27B | ā |
| gpt-oss:20b | 20B | ā |
| ministral-3 | 3B | ā |
| functiongemma | 270M | ā |
| deepseek-r1:7b | 7B | ā |
š„ Demo video: Ollama37 v2.0.3 on Tesla K80ā
# Pull and run
docker pull dogkeeper886/ollama37:v2.0.3
docker run --runtime=nvidia --gpus all -p 11434:11434 dogkeeper886/ollama37
version: "3.8"
services:
ollama:
image: dogkeeper886/ollama37:latest
container_name: ollama37
runtime: nvidia
deploy:
resources:
reservations:
devices:
- driver: nvidia
count: all
capabilities: [gpu]
ports:
- "11434:11434"
volumes:
- ollama-data:/root/.ollama
environment:
- OLLAMA_HOST=0.0.0.0:11434
- NVIDIA_VISIBLE_DEVICES=all
- NVIDIA_DRIVER_CAPABILITIES=compute,utility
restart: unless-stopped
healthcheck:
test: ["CMD", "/usr/local/bin/ollama", "list"]
interval: 30s
timeout: 10s
retries: 3
start_period: 5s
volumes:
ollama-data:
name: ollama-data
docker-compose up -d
# Download and run a model
ollama pull gemma3
ollama run gemma3 "Why is the sky blue?"
# Interactive chat
ollama run gemma3
ollama list # List models
ollama show llama3.2 # Model info
ollama ps # Running models
ollama stop llama3.2 # Stop model
ollama serve # Start server
Found an issue or want to contribute? Check our GitHub issuesā or submit Tesla K80-specific bug reports and compatibility fixes.
Same license as upstream Ollama. See LICENSE file for details.
Content type
Image
Digest
sha256:10eb85c9fā¦
Size
539.8 MB
Last updated
9 days ago
docker pull dogkeeper886/ollama37