GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GR
granite-8b-code-instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
BA
bagel dpo 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
LL
Llama-3-Luminurse-v0.1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ZE
Zen Voyager
Zen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
TR
Trion-M-7b
Trion · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GP
GPT4chan 8B
Gpt · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MO
MoNeuTrix MoE 4x7B
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GE
Huihui Gemma 4 12B Agentic Fable5 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen2.5 7B Instruct 1M Thinking Claude Gemini GPT5.2 DISTILL
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
QW
Qwen3.8 27B RANA Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
RA
Radon 35B Ultra X RU
Radon · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
MI
Mixtral 8x7B v0.1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
NS
NSK 128k 7B slerp
Nsk · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
GP
Gpt Oss 20b Tainted Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
LL
CodeLlama 7b CypherGen
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.2 GB
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Ministral-3-14B-Nymphaea-RP
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
QQ
qqWen 32B Pretrain
Qqwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
OP
OpenChat 3.5 7B Starling v2.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB