Qwen2.5-Coder-7B-Instruct Q4_K_M GGUF for Docker Model Runner (chat)
21
Alibaba Cloud's 7B coding model, from the Qwen team's own Q4_K_M GGUF.
docker model pull baransels/qwen2.5-coder-7b-instruct:Q4_K_M
docker model run baransels/qwen2.5-coder-7b-instruct:Q4_K_M "Write a Python function that checks if a string is a palindrome."
| Original model | GGUF | Licence |
|---|---|---|
| Qwen/Qwen2.5-Coder-7B-Instruct | Qwen/Qwen2.5-Coder-7B-Instruct-GGUF | Apache-2.0 |
Not an official artifact. Packaged by Baransel Saginda.
Content type
Model
Digest
sha256:857ac2029…
Size
4.4 GB
Last updated
4 days ago
docker model pull baransels/qwen2.5-coder-7b-instruct:Q4_K_M