GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
GL
GLM 4.7 Flash Derestricted
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
ST
stablelm-zephyr-3b
Stablelm · mradermacher
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CY
CyberPal-2.0-20B
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
LL
Llama3 Aloe 8B Alpha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SU
Supergemma4 E4B Abliterated
Supergemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Tool use
PI
PiVoT SUS RP i1
Pivot · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
Roleplay
CH
chronoboros 33B i1
Chronoboros · mradermacher
Params32.5B
Context2K
Q4_K_M19.9 GB
GGUF
MI
Devstral Small 2507 Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingVision
QW
Qwen3.5 9B Deckard Claude DIMOE Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
XW
Xwinter 120b i1
Xwinter · mradermacher
Params118B
Context4K
Smallest25.0 GB
GGUF
LL
Meta Llama 3.1 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 4b Z Image Turbo AbliteratedV1
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2-NT
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CO
CoT 2.5 i1
Cot · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
AL
Alpacino30b i1
Alpacino · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 4B Unfiltered
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
RoleplayVision
MI
Mistral-11B-SynthIAirOmniMix
Mistral · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
CY
CyberOss 2.0 20B i1
Cyberpal · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
Roleplay
LL
CodeLlama 13b Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen3.5 9B Claude 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
CodingReasoningTool use
BO
B2 Bophades 9B
Bophades · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
QW
Hemlock Qwen2.5 Coder 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Coding
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF

Keep browsing