GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
ED
EdgeRunner Command Nested
Edgerunner · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
GGUF
GE
Gemma4 31b Opus Reasoning v5
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision
ZE
Zephyr 7b Beta Abliterated
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen35B Agent R2 Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
KL
Klyrune 2B General
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
MI
Mistral NeuralDPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
RO
RolmOCR
Rolmocr · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool useVision
BO
Borealis Open 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
OL
Olmo 3 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
SW
Swallow-13b-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
QW
Qwen3.5 9B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Zhi Create Qwen3 32B
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
Reasoning
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
CO
Yi Coder 9B
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
LL
Llama-3-Groq-70B-Tool-Use
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
Tool use
ZE
zephyr 7b alpha
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
EL
Elysium2.1-11b
Elysium · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
GGUF
MO
MOSS Image Text Encoder Heretic
Moss · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
KI
Kimi Linear REAP 35B A3B Instruct i1
Kimi · mradermacher
Params35B
Context1024K
Q4_K_M21.3 GB
GGUF
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB
GGUF
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CodingTool use
GE
Gemma 3 12b It Vl HighIQ Polaris Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
ST
L3-8B-Stheno-v3.2
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
CodingVision
KA
Kairos
Kairos · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
GGUF
VE
Veritas 12B
Veritas · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
CO
COBOL Coder 7B Instruct i1
Cobol · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
LL
Llama3.1 Nemo Thinker
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Q4_K_M1.9 GB
Coding
CH
Chocolatine 14B Instruct 4k DPO i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
GGUF

Keep browsing