Jan-v3.5-4B Q4_K_M GGUF for Docker Model Runner (chat)
16
Jan's 4B chat model, tuned for math reasoning, with its own personality.
docker model pull baransels/jan-v3.5-4b:Q4_K_M
docker model run baransels/jan-v3.5-4b:Q4_K_M "If a train leaves at 14:20 and the trip takes 2 h 55 min, when does it arrive?"
| Original model | GGUF | Licence |
|---|---|---|
| janhq/Jan-v3.5-4B | janhq/Jan-v3.5-4B-gguf | Apache-2.0 (base model Qwen3-4B-Instruct-2507 is Apache-2.0) |
Not an official artifact. Packaged by Baransel Saginda.
Content type
Model
Digest
sha256:926479d0a…
Size
2.5 GB
Last updated
3 days ago
docker model pull baransels/jan-v3.5-4b:Q4_K_M