GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
EK
Ekbasis 27B
Ekbasis · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
KA
KansenSakura Eclipse RP 12b
Kansensakura · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
OP
openbuddy-yi1.5-34b-v21.3-32k
Openbuddy · mradermacher
Params34.4B
Context128K
Q4_K_M20.7 GB
LL
Llama 3.2 3B Instruct
Llama · mradermacher
Params3.61B
Context128K
Q4_K_M2.2 GB
GE
Gemma 4 12B It Heretic_Decensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
MiniCPM V 4.7 1B Heretic
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
HY
HyperNova 60B
Hypernova · mradermacher
Params58.7B
Context128K
Q4_K_M40.7 GB
QW
WhereOPD Qwen3.5 4B
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
LL
Llama-3-Instruct-Neurona-8b-v2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LF
LFM2.5 24B A2B Abliterated
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
DE
Qwen3 30B A3B Deepseek Distill Instruct 2507
DeepSeek · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
MixTaoTruthful-13B-slerp
Mixtaotruthful · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
ST
Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
BO
Borealis Open 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
QW
DPO Trained Qwen2.5 Python Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CH
Chaotic Order 24B V5
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
DarkIdol Qwen3.8 27B v1.1
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 2B Uncensored Zero Refusal SOMA
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
LL
CodeLlama 70b Hf
Llama · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
DE
Deacon-34B
Deacon · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
DA
Dark Scarlett 27B v2.0
Dark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
FA
FashionGPT 70B V1.2 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
RE
REBEL-OpenChat-3.5
Rebel · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
MU
Muse Glimmer 30B AZ Focus
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3 14B NSFW FDA
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GP
SpaceQA Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
IN
Internlm2 Math Plus 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB