GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
GU
Guanaco 7B Uncensored
Guanaco · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
HU
Huihui3.5 67B A3B Abliterated
Huihui · mradermacher
Params67B
Context256K
Q4_K_M40.8 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
SP
Spark X2.6 4B Uncensored
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
IR
Iris 12B v1.4.1
Iris · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
SW
Swallow-7b-NVE-instruct-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
IN
Internlm2 Math 20b
InternLM · mradermacher
Params19.9B
Context8K
Q4_K_M12.0 GB
GGUF
QW
rombos Replete Coder Qwen2 1.5b i1
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
YI
Mahou-1.3-yi-9B
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
AD
AdaGuard 8B
Adaguard · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
MI
Ministral-3-8B-Nymphaea-RP
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
RoleplayTool useVision
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 VL 32B Thinking Heretic v2
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
CodingReasoningVision
QW
Qwen3.8 27B TURBO Fable Cold Fusion 735 882 Heretic Uncensored NM DAU
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
QW
Qwen3 32B VL GLM 4.7 Flash HI16 Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningRoleplayVision
OL
OLMoE 1B 7B 0924 Instruct
OLMo · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
QW
Qwen3.5 27B RpRMax v1
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
QW
Qwen3.5 27B Abliterated Ko
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
OM
Omni Edu 27B
Omni · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
PY
Pythia 6.9b
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
GGUF
NO
Novaeus Promptist 7B Instruct i1
Novaeus · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MO
MoNeuTrix MoE 4x7B i1
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
IR
Irene-RP-v2-7B_128k
Irene · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LE
LemonKunoichiWizardV3
Lemonkunoichiwizardv · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing