GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Qwen3.5 4B Heretic 2xMerge DavidAU
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
AR
Artemis 31B v1.2 Abliterix v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SW
Swallow-7b-instruct-v0.1
Swallow · mradermacher
Params6.83B
Context4K
Q4_K_M4.1 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
LL
Hermes 3 Llama 3.1 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
miquplus-xwin-70b
Miquplus · mradermacher
Params69B
Context32K
Q4_K_M41.4 GB
QW
AgentMercury Qwen3.5 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
OX
OxCoder 9B GMCE
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
YI
dolphin-2.9.1-yi-1.5-34b
Yi · mradermacher
Params34.4B
Context8K
Q4_K_M20.7 GB
QW
Qwen2.5 Coder 32B Instruct Uncensored i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
DE
DeepSeek R1 Distill Qwen 1.5B Abliterated
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
GR
Granite 7b Base
Granite · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
IC
IceTea21EnergyDrinkRPV13 DPOv3 i1
Icetea · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
ConfigurableSOLAR 10.7B i1
Configurablesolar · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
QW
Qwepus
Qwepus · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
LL
Llama 3.3 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
LL
UCCIX Llama2 13B i1
Llama · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
DA
daybreak kunoichi dpo 7b
Daybreak · mradermacher
Params7.24B
Context16K
Q4_K_M4.5 GB
LI
Ling 3.0 Flash Heretic
Ling · mradermacher
Params127B
Context256K
Q4_K_M77.0 GB
FA
FashionGPT 70B V1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
RE
ReFeed 8B
Refeed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Behemoth X 123B v2.2
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
MI
llava v1.6 mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
MU
Muse Glimmer 30B Uncensored Heretic
Muse · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
SP
Spark X2.5 4B
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
SE
Semancer 12B
Semancer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 Coder 30B A3B IT Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
HE
Hemmingway 1.5
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB