GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.5 40B RoughHouse Claude 4.6 Opus Polar Deckard Uncensored Heretic Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
MI
Mistral Small 24B Instruct 2501 Heretic
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
LI
Lil Beastie 4b
Lil · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
NE
Neuron 4B Instruct
Neuron · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
NE
Neuraljack 12B MoE
Neuraljack · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
KI
RP King 12b
King · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
BO
Borealis 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
QW
Qwen2.5 14B Instruct Abliterated
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Colossal LLaMA 2 7b Base
Llama · mradermacher
Params7.04B
Context4K
Q4_K_M4.3 GB
SI
Signal 3.8 27B Terse Coder
Signal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GR
Granite 4.1 8b Abliterated AND Disinhibited
Granite · mradermacher
Params8.38B
Context128K
Q4_K_M5.1 GB
QW
QiMing Holos Plus Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen2.5 3B Instruct Heretic
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
ME
MegaDolphin 120b i1
Megadolphin · mradermacher
Params120B
Context4K
Smallest25.6 GB
LL
Mini Lama 8B Base
Llama · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
SP
Spark X2.6 4B Base
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
LL
llama 65b instruct
Llama · mradermacher
Params65B
Context2K
Q4_K_M39.3 GB
SE
SearchQwen2.5 7B
Searchqwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
PL
Pluto i1
Pluto · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
MI
General Stories Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
L3 DARKEST PLANET 16.5B i1
Darkest · mradermacher
Params16.5B
Context8K
Q4_K_M10.0 GB
EG
Ege 8b 1.1
Ege · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.8 Queen 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
KE
Keural Cortex 8B v1.0 1
Keural · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled Abliterated
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
ME
MedGo
Medgo · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
ED
EdgeRunner Command Nested
Edgerunner · mradermacher
Params7.6B
Context32K
Q4_K_M4.7 GB