ai/llama3.2

Docker

Solid LLaMA 3 update, reliable for coding, chat, and Q&A tasks

ai/llama3.1

Docker

Meta’s LLama 3.1: Chat-focused, benchmark-strong, multilingual-ready.

ai/gemma3-vllm

Docker

Google’s latest Gemma, small yet strong for chat and generation

ai/smollm3

Docker

SmolLM3 is a 3.1B model for efficient on-device use, with strong performance in chat

Q4_K_M GGUF of a MedGemma health-chat fine-tune for local, private clinical AI prototyping.

aistaging/gemma3

aistaging

Google’s latest Gemma, small yet strong for chat and generation

Qwen 3.6 35B A3B GGUF quantizations from Unsloth Studio with the Nail chat template.