GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
GU
Guanaco 7B Uncensored
Guanaco · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
HU
Huihui3.5 67B A3B Abliterated
Huihui · mradermacher
Params67B
Context256K
Q4_K_M40.8 GB
MI
Ministral 3 14B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
SP
Spark X2.6 4B Uncensored
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
IR
Iris 12B v1.4.1
Iris · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
SW
Swallow-7b-NVE-instruct-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
QW
rombos Replete Coder Qwen2 1.5b i1
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
YI
Mahou-1.3-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
AD
AdaGuard 8B
Adaguard · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
MI
Ministral-3-8B-Nymphaea-RP
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 VL 32B Thinking Heretic v2
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 32B VL GLM 4.7 Flash HI16 Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
OL
OLMoE 1B 7B 0924 Instruct
OLMo · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
QW
Qwen3.5 27B RpRMax v1
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
Qwen3.5 27B Abliterated Ko
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
OM
Omni Edu 27B
Omni · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
PY
Pythia 6.9b
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
NO
Novaeus Promptist 7B Instruct i1
Novaeus · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MO
MoNeuTrix MoE 4x7B i1
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
IR
Irene-RP-v2-7B_128k
Irene · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LE
LemonKunoichiWizardV3
Lemonkunoichiwizardv · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB