GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
ED
EdgeRunner Command Nested
Edgerunner · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB
GE
Gemma4 31b Opus Reasoning v5
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ZE
Zephyr 7b Beta Abliterated
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen35B Agent R2 Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
KL
Klyrune 2B General
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
MI
Mistral NeuralDPO
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
RO
RolmOCR
Rolmocr · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
BO
Borealis Open 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
OL
Olmo 3 7B Think
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
SW
Swallow-13b-hf
Swallow · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
QW
Qwen3.5 9B Ultra Uncensored Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Zhi Create Qwen3 32B
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.5 122B A10B Abliterated
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
CO
Yi Coder 9B
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
LL
Llama-3-Groq-70B-Tool-Use
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
ZE
zephyr 7b alpha
Zephyr · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EL
Elysium2.1-11b
Elysium · mradermacher
Params11.2B
Context32K
Q4_K_M6.7 GB
MO
MOSS Image Text Encoder Heretic
Moss · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
KI
Kimi Linear REAP 35B A3B Instruct i1
Kimi · mradermacher
Params35B
Context1024K
Q4_K_M21.3 GB
YI
Yi-9B-200K
Yi · mradermacher
Params8.83B
Context256K
Q4_K_M5.3 GB
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 3 12b It Vl HighIQ Polaris Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ST
L3-8B-Stheno-v3.2
Stheno · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
KA
Kairos
Kairos · mradermacher
Params8.2B
Context32K
Q4_K_M5.0 GB
VE
Veritas 12B
Veritas · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CO
COBOL Coder 7B Instruct i1
Cobol · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama3.1 Nemo Thinker
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ST
Starcoder2 3b
StarCoder · mradermacher
Params3.03B
Context16K
Q4_K_M1.9 GB
CH
Chocolatine 14B Instruct 4k DPO i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB