GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 E4B It The DECKARD Expresso Universe HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingReasoningRoleplay
QW
Gliese Qwen3.5 9B Abliterated Caption
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
ST
Stellar Witch 12B Heretic
Stellar · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
CA
Carbon X
Carbon · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
GE
Gemini Nano Gemmafied
Gemma · mradermacher
Params3.24B
Context8K
Q4_K_M2.1 GB
GGUF
CO
Q2.5 ColdBrew R1 ForgeWide SAFE
Coldbrew · mradermacher
Params9.5B
Context128K
Q4_K_M5.8 GB
Reasoning
ST
Dolphincoder Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
CodingTool use
MI
Mistral Small 24B Instruct 2501 Abliterated
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
MI
Mixtral 8x7B v0.1 instruct l2 norm post SFT pruned 3 experts
Mistral · mradermacher
Params29.8B
Context32K
Q4_K_M18.0 GB
GGUF
TR
Translategemma 4b It
Translategemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GL
Huihui GLM 4.6V Flash Abliterated
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
Vision
IN
InnoSpark3.1 27B 1008
Innospark · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3.5 27B Writer V2 Uncensored Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
GE
Locus Gemma 4 E2B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
QW
Qwen3 The Xiaolong Omega Directive 22B Uncensored Abliterated
Qwen · mradermacher
Params22B
Context40K
Q4_K_M13.3 GB
Roleplay
LL
LightGPT 7B Llama2
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
BO
boto-9B
Boto · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Prettybird_Bce_Basic_Coder_8B
Qwen · mradermacher
Params7.6B
Context63K
Q4_K_M4.7 GB
Coding
GL
Glimmer 31B v1.0
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
CY
Cydonia 24B v4.1
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
KA
KAI 7B Instruct v0.1
Kai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
GL
GLM 4.5 Iceblink v3 106B A12B
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
Roleplay
LL
Tiamat 8b 1.2 Llama 3 DPO i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CL
Claude2 Alpaca 13B
Claude · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
MI
Mistral Magistral Devstral Instruct FUSED CODER Reasoning 36B
Mistral · mradermacher
Params35.8B
Context128K
Q4_K_M21.7 GB
CodingReasoning
KA
KangalKhan Alpha Emerald 7B
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
YI
Yi 1.5 9B Chat Abliterated
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
QW
Qwen3 ASR 1.7B
Qwen · mradermacher
Params2.03B
Context64K
Q4_K_M1.3 GB
Vision
GE
Gemma 4 Garnet 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF

Keep browsing