Mellum GGUF models
91 GGUF models in the Mellum family, quantized by 35 uploaders. Sizes run from 833M to 12.6B parameters. The longest trained context is 128K tokens.
ME
JetBrains.Mellum2 12B A2.5B Thinking
Mellum · DevQuasar
Params12.1B
Context128K
Q4_K_M8.1 GB
ME
JetBrains.Mellum 4b Base
Mellum · DevQuasar
Params4.02B
Context8K
Q4_K_M2.6 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · NANI-Nithin
Params12.1B
Context128K
Q4_K_M8.1 GB
ME
Mellum 4b Dpo Python
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
ME
Mellum2.1-12B-A2.5B-Thinking
Mellum · Thefaresmostafa
Params12.1B
Context128K
Q4_K_M8.1 GB
ME
Mellum2.1 12B A2.5B Thinking Q4 K M ZATTU
Mellum · jayjay03311
Params12.1B
Context128K
Q4_K_M6.6 GB
ME
Mellum 4b dpo all
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
ME
Mellum 4b Dpo All
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
ME
Mellum2.1 12B A2.5B Thinking abliterated
Mellum · distributedcognition
Params12.1B
Context128K
Q4_K_M8.1 GB
ME
Mellum2 12B A2.5B Base
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest24.3 GB
ME
Mellum 4b sft python
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
ME
Mellum 4b Sft All
Mellum · ravizhan
Params4.02B
Context8K
Q4_K_M2.6 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · JetBrains
Params12.1B
Context128K
Smallest24.3 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · RJ000
Params12.1B
Context128K
Q4_K_M8.1 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
ME
Mellum 4b Sft Python
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
ME
Mellum2 12B A2.5B Instruct tuned pep750
Mellum · postrational
Params12.1B
Context128K
Q4_K_M8.1 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.8 GB
ME
Mellum2 12B A2.5B Thinking GGUF mixed q4 q8
Mellum · dpcpw
Params12.1B
Context128K
Smallest8.5 GB
ME
Mellum 4b dpo python
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.8 GB
ME
Mellum2 12B A2.5B Thinking GGUF etheroi
Mellum · developerjeremylive
Params12.1B
Context128K
Q4_K_M8.1 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · sasasin-net
Params12.1B
Context128K
Smallest7.4 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.6 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.6 GB
ME
Mellum2 12B A2.5B Instruct
Mellum · TobDeBer
Params12.1B
Context128K
Smallest6.6 GB
ME
Mellum 4b Dpo All
Mellum · shaylinc
Params4.02B
Context8K
Smallest2.3 GB
ME
Mellum2 12B A2.5B Thinking
Mellum · bombman
Params12.1B
Context128K
Q4_K_M8.1 GB