ai/smollm3

Docker

SmolLM3 is a 3.1B model for efficient on-device use, with strong performance in chat

ai/granite-4.0-h-nano

Docker

Granite-4.0-h-nano: lightweight instruct model trained via SFT, RL, and merging on diverse data.

ai/functiongemma-vllm

Docker

FunctionGemma is a 270M open model for fine-tuned, offline function-calling agents on small devices.

ai/granite-4.0-nano

Docker

Granite-4.0-nano: lightweight instruct model trained via SFT, RL, and merging on diverse data.

Based on Unsloth GGUF quant UD-IQ3_S with multimodality fix (package mmproj) for Docker Model Runner