ERNIE-4.5-21B-A3B-Thinking Q4_K_M GGUF for Docker Model Runner (chat)
34
Baidu's mixture-of-experts reasoning model (21B total, 3B active). It thinks before answering, so first replies are slow.
docker model pull baransels/ernie-4.5-21b-a3b-thinking:Q4_K_M
docker model run baransels/ernie-4.5-21b-a3b-thinking:Q4_K_M "How many prime numbers are there below 50?"
| Original model | GGUF | Licence |
|---|---|---|
| baidu/ERNIE-4.5-21B-A3B-Thinking | unsloth/ERNIE-4.5-21B-A3B-Thinking-GGUF | Apache-2.0 |
Not an official artifact. Packaged by Baransel Saginda.
Content type
Model
Digest
sha256:3bebeceb4…
Size
12.4 GB
Last updated
about 6 hours ago
docker model pull baransels/ernie-4.5-21b-a3b-thinking:Q4_K_M