GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
ST
stablelm-zephyr-3b
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CY
CyberPal-2.0-20B
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
Llama3 Aloe 8B Alpha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
SU
Supergemma4 E4B Abliterated
Supergemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
PI
PiVoT SUS RP i1
Pivot · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
CH
chronoboros 33B i1
Chronoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
MI
Devstral Small 2507 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.5 9B Deckard Claude DIMOE Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
XW
Xwinter 120b i1
Xwinter · mradermacher
Params118B
Context4K
Smallest25.0 GB
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3 4b Z Image Turbo AbliteratedV1
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2-NT
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CO
CoT 2.5 i1
Cot · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
AL
Alpacino30b i1
Alpacino · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LL
LongWriter Llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5 4B Unfiltered
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
CY
CyberOss 2.0 20B i1
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5 9B Claude 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
BO
B2 Bophades 9B
Bophades · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Hemlock Qwen2.5 Coder 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB