Mellum GGUF models

91 GGUF models in the Mellum family, quantized by 35 uploaders. Sizes run from 833M to 12.6B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ME
JetBrains.Mellum2 12B A2.5B Thinking
Mellum · DevQuasar
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
ME
JetBrains.Mellum 4b Base
Mellum · DevQuasar
Params4.02B
Context8K
Q4_K_M2.6 GB
GGUF
ME
Mellum2 12B A2.5B Instruct
Mellum · NANI-Nithin
Params12.1B
Context128K
Q4_K_M8.1 GB
Tool use
ME
Mellum 4b Dpo Python
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum2.1-12B-A2.5B-Thinking
Mellum · Thefaresmostafa
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use
ME
Mellum2.1 12B A2.5B Thinking Q4 K M ZATTU
Mellum · jayjay03311
Params12.1B
Context128K
Q4_K_M6.6 GB
ReasoningTool use
ME
Mellum 4b dpo all
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
Coding
ME
Mellum 4b Dpo All
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum2.1 12B A2.5B Thinking abliterated
Mellum · distributedcognition
Params12.1B
Context128K
Q4_K_M8.1 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Base
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
CodingTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · JetBrains
Params12.1B
Context128K
Smallest24.3 GB
Tool use
ME
Mellum 4b sft python
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
Coding
ME
Mellum 4b Sft All
Mellum · ravizhan
Params4.02B
Context8K
Q4_K_M2.6 GB
GGUF
ME
Mellum2 12B A2.5B Thinking
Mellum · JetBrains
Params12.1B
Context128K
Smallest24.3 GB
ReasoningTool use
ME
Mellum2 12B A2.5B Thinking
Mellum · RJ000
Params12.1B
Context128K
Q4_K_M8.1 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
CodingTool use
ME
Mellum2 12B A2.5B Thinking
Mellum · SandLogicTechnologies
Params12.1B
Context128K
Smallest5.9 GB
CodingReasoningTool use
ME
Mellum 4b Sft Python
Mellum · mradermacher
Params4.02B
Context8K
Q4_K_M2.6 GB
Coding
ME
Mellum2 12B A2.5B Instruct tuned pep750
Mellum · postrational
Params12.1B
Context128K
Q4_K_M8.1 GB
Tool use
ME
Mellum2 12B A2.5B Thinking
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.8 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Thinking GGUF mixed q4 q8
Mellum · dpcpw
Params12.1B
Context128K
Smallest8.5 GB
CodingReasoningTool use
ME
Mellum 4b dpo python
Mellum · JetBrains
Params4.02B
Context8K
Smallest4.3 GB
Coding
ME
Mellum2 12B A2.5B Instruct
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.8 GB
CodingTool use
ME
Mellum2 12B A2.5B Thinking GGUF etheroi
Mellum · developerjeremylive
Params12.1B
Context128K
Q4_K_M8.1 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Thinking
Mellum · sasasin-net
Params12.1B
Context128K
Smallest7.4 GB
ReasoningTool use
ME
Mellum2 12B A2.5B Thinking
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.6 GB
CodingReasoningTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · kingjones777
Params12.1B
Context128K
Smallest12.6 GB
CodingTool use
ME
Mellum2 12B A2.5B Instruct
Mellum · TobDeBer
Params12.1B
Context128K
Smallest6.6 GB
GGUF
ME
Mellum 4b Dpo All
Mellum · shaylinc
Params4.02B
Context8K
Smallest2.3 GB
Coding
ME
Mellum2 12B A2.5B Thinking
Mellum · bombman
Params12.1B
Context128K
Q4_K_M8.1 GB
ReasoningTool use

Keep browsing