baransels/mellum2.1-12b-a2.5b-thinking repository overview

⁠Mellum2.1-12B-A2.5B-Thinking · Q4_K_M

JetBrains' mixture-of-experts reasoning model (12B total, 2.5B active), from JetBrains' own Q4_K_M GGUF. It thinks inside <think> blocks before answering, so first replies are slow.

docker model pull baransels/mellum2.1-12b-a2.5b-thinking:Q4_K_M
docker model run baransels/mellum2.1-12b-a2.5b-thinking:Q4_K_M "How many prime numbers are there below 50?"

Not an official artifact. Packaged by Baransel Saginda⁠.