ai/llama3.2

Docker

Solid LLaMA 3 update, reliable for coding, chat, and Q&A tasks

ai/gemma4-safetensors

Docker

Gemma 4: multimodal open AI models by Google, optimized for reasoning, coding, and long context.

ai/deepseek-r1-distill-llama

Docker

Distilled LLaMA by DeepSeek, fast and optimized for real-world tasks

ai/gemma3-qat

Docker

Google’s latest Gemma, in its QAT (quantization aware trained) variant

ai/qwen2.5

Docker

Versatile Qwen update with better language skills and wider support

ai/mxbai-embed-large

Docker

mxbai-embed-large-v1 is a top English embed model by Mixedbread AI, great for RAG and more.

ai/llama3.3

Docker

Newest LLama 3 release with improved reasoning and generation quality

ai/phi4

Docker

Microsoft’s compact model, surprisingly capable at reasoning and code

ai/magistral-small-3.2

Docker

24B multimodal instruction model by Mistral AI, tuned for accuracy, tool use & fewer repeats

ai/ministral3

Docker

Ministral 3: compact vision-enabled model with near-24B performance, optimized for local edge use

ai/smollm3

Docker

SmolLM3 is a 3.1B model for efficient on-device use, with strong performance in chat

ai/qwen3-coder-next

Docker

Efficient 80B MoE coding model with 3B activated params, 256K context, and agentic capabilities

ai/mistral

Docker

Efficient open model with top-tier performance and fast inference

ai/kimi-k2

Docker

Kimi K2 Thinking: open-source agent with deep reasoning, stable tool use, fast INT4, 256k context.

ai/stable-diffusion

Docker

Image generation model, uses a base latent diffusion model plus a refiner.

ai/deepcoder-preview

Docker

DeepCoder-14B-Preview is a code reasoning LLM fine-tuned to scale up to long context lengths

ai/ministral3-vllm

Docker

Ministral 3: compact vision-enabled model with near-24B performance, optimized for local edge use