GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mahou-1.3a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 30B A3B Instruct 2507 REAM Heretic
Qwen · mradermacher
Params23.3B
Context256K
Q4_K_M14.2 GB
GGUF
CY
Cydonia 24B v4.3 Heretic v3
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
EL
electric mist 7b
Electric · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LL
Llama 3.1 Nemotron 70B Instruct HF abliterated i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
DA
danube2-1.8b-WizardLM-Evol-V2-Unfiltered
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
AG
L3.1 Aglow Vulca v0.1 8B i1
Aglow · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LO
Louis GRC 7B slerp M2
Louis · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
GR
granite 20b code instruct
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
CodingTool use
MI
MixtralOrochi8x7B Alt
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
NE
Nemostein 3 Hermes Omni 30b A3B
Nemostein · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
ReasoningTool use
GR
MN GRAND Gutenberg Lyra4 Lyra 12B MADNESS i1
Grand · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
FA
Falcon H1 7B Instruct
Falcon · mradermacher
Params7.59B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
SO
SOLAR 0 70b 16bit
Solar · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
MathSmith HC Problem Synthesizer Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
YI
blossom v3 1 yi 34b i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
NE
NeoHorse 1 9B Heretic
Neohorse · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen2.5 Coder 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
CodingTool use
WA
WazoCore 8B v6 Long
Wazocore · mradermacher
Params8.15B
Context128K
Q4_K_M5.0 GB
Tool use
MO
Mochi 4B
Mochi · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
UM
Umbra v2.1 MoE 4x10.7 i1
Umbra · mradermacher
Params36B
Context32K
Q4_K_M22.0 GB
GGUF
DE
Qwen2.5 32B
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
GE
Gemma 4 26B A4B It ARA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
MA
Mag Picaro 72B
Mag · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Roleplay
GE
Gemma 3 12b It Vl Minimax M2.1 Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
NE
Next 12b
Next · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
GGUF
AU
Aurora Code 1
Aurora · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QU
QuasiStarSynth 12B Noslop Absolute Heresy
Quasistarsynth · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF

Keep browsing