Mellum GGUF models

91 GGUF models in the Mellum family, quantized by 35 uploaders. Sizes run from 833M to 12.6B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
Mellum 4b Sft Python
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum2 12B A2.5B Thinking Abliterated
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · junwatu
Params12.1B
Context128K
Q4_K_M8.1 GB
CodingTool use
ME
Mellum 4b Sft Rust
Mellum · Etherll
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum 4b Base
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum 4b Dpo All
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum 4b Base
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum 4b sft kotlin
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
Coding
ME
Mellum2 12B A2.5B Thinking
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
ME
Mellum2 12B A2.5B Instruct SFT
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
Tool use
ME
Mellum2 12B A2.5B Thinking SFT
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
ME
JetBrains.Mellum 4b Sft All
Mellum · DevQuasar
Params4.02B
Context8K
Q4_K_M2.6 GB
GGUF
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest7.0 GB
Tool use
ME
Mellum2 12b
Mellum · Myric
Params12.1B
Context128K
Smallest6.9 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Thinking
Mellum · CodeFault
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
ME
Mellum-4b-base
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
Coding
ME
Mellum2 12B A2.5B Thinking
Mellum · JetBrains
Params12.1B
Context128K
Smallest10.9 GB
ReasoningTool use
ME
Mellum2.1 12B A2.5B Thinking DevSec
Mellum · Nullmega
Params12.1B
Context128K
Q4_K_M8.1 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
Tool use
ME
Mellum2 12B A2.5B Thinking Dflash GGUF FIXED
Mellum · rpatel622
Params833M
Context128K
Q4_K_M0.5 GB
Reasoning
ME
Mellum 4b Sft Rust
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum2 12B A2.5B Base code
Mellum · Ruka6
Params12.1B
Context128K
Smallest0.1 GB
GGUF
ME
Mellum2 12B A2.5B Thinking
Mellum · JSchneemann
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest10.9 GB
Tool use
ME
Mellum 4b sft all
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
Coding
ME
JetBrains.Mellum 4b Sft Python
Mellum · DevQuasar
Params4.02B
Context8K
Q4_K_M2.6 GB
GGUF
ME
Mellum2 12B A2.5B Instruct
Mellum · CodeFault
Params12.1B
Context128K
Q4_K_M8.1 GB
Tool use
ME
Mellum2 12B A2.5B Thinking
Mellum · kingjones777
Params12.1B
Context128K
Smallest7.0 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · kingjones777
Params12.1B
Context128K
Smallest7.0 GB
CodingTool use
ME
Mellum2-12B-A2.5B-Thinking
Mellum · Mungert
Params12.1B
Context128K
Q4_K_M8.2 GB
ReasoningTool use

Keep browsing