GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
GP
GPT OSS Swallow 120B RL v0.1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
JA
Jais adapted 7B Reflection Tuning Natural Farmer i1
Jais · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
OR
Orion 26B A4B v1.1
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 Queen 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
QW
Qwen3 Coder Next Uncensored Heretic
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
CO
Yi Coder 1.5B Chat
Coder · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
MI
Mahou-1.3-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniCPM V 4.7 1B
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
MI
Mia v2 29B
Mia · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
EU
Eurus 70b nca fixed i1
Eurus · mradermacher
Params69B
Context16K
Q4_K_M41.4 GB
GE
Gemma 3 4b It Heretic Uncensored Abliterated Extreme
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
TE
Tenebra_30B_Alpha01_FP16
Tenebra · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
QW
Qwen3.6 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ST
stable-code-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
LI
LightOnOCR 3 0.8B
Lightonocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
BE
BetterWright K2 Horizon 7B Uno
Betterwright · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GE
Gemma 4 19B A4B It INSTRUCT Heretic Uncensored
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
AV
Avrik Lite 4B
Avrik · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
CY
Cydonia 24B v4.3 Absolute Heresy
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
CodeLlama 7b Instruct Hf
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
LL
rombos Llama3 8B Instruct Replete Adapted i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
YI
Faro Yi 34B i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
WI
WizardCoder Python 13B V1.0 i1
Wizardcoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
ShiningValiant
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
CH
Chocolatine 14B Instruct DPO v1.2 i1
Chocolatine · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
QW
Qwen3.8 27B Finance
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB