Mellum2-12B-A2.5B-Instruct Q8_0 GGUF for Docker Model Runner (chat)
36
JetBrains' coding model (12B total, 2.5B active).
docker model pull baransels/mellum2-12b-a2.5b-instruct:Q8_0
docker model run baransels/mellum2-12b-a2.5b-instruct:Q8_0 "Write a Python function that checks if a string is a palindrome."
| Original model | GGUF | Licence |
|---|---|---|
| JetBrains/Mellum2-12B-A2.5B-Instruct | JetBrains/Mellum2-12B-A2.5B-Instruct-GGUF-Q8_0 | Apache-2.0 |
Not an official artifact. Packaged by Baransel Saginda.
Content type
Model
Digest
sha256:94f3d1508…
Size
12 GB
Last updated
about 5 hours ago
docker model pull baransels/mellum2-12b-a2.5b-instruct:Q8_0