Qwen2.5-Coder-32B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)
36
Alibaba Cloud's 32B coding model, from the Qwen team's own Q4_K_M GGUF.
docker model pull baransels/qwen2.5-coder-32b-instruct:Q4_K_M
docker model run baransels/qwen2.5-coder-32b-instruct:Q4_K_M "Write a Python function that checks if a string is a palindrome."
| Original model | GGUF | Licence |
|---|---|---|
| Qwen/Qwen2.5-Coder-32B-Instruct | Qwen/Qwen2.5-Coder-32B-Instruct-GGUF | Apache-2.0 |
Not an official artifact. Packaged by Baransel Saginda.
Content type
Model
Digest
sha256:18082e224…
Size
18.5 GB
Last updated
1 day ago
docker model pull baransels/qwen2.5-coder-32b-instruct:Q4_K_M