GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
Mistral Scary Story Finetune
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 2 Ataraxy 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SY
Sydney_Overthinker_13b_HF
Sydney · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
IN
InverseCoder-CL-13B
Inversecoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
LL
Llama-3-8B-Irene-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Bella Tao Merged Qwen2_5 Coder 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 26B A4B Preserving Abliteration
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
NO
Nous Capybara 34B
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
OP
openchat 3.5 i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen3.6 28B REAP
Qwen · mradermacher
Params28.2B
Context256K
Q4_K_M17.3 GB
KU
KukulStanta InfinityRP 7B slerp i1
Kukulstanta · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 3 Uncensored_v2 Merged
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5 Creative 19B A3B REAP
Qwen · mradermacher
Params18.5B
Context256K
Q4_K_M11.4 GB
NE
NeoCortex 7B slerp
Neocortex · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
HU
Huihui Hunyuan MT Chimera 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
CL
Claire 7B 0.1
Claire · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
WI
WizardMath 7B V1.1 i1
Wizardmath · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
DA
danube2-1.8b-Synthia-v1.3
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
IC
IceTea21EnergyDrinkRPV13 dpo240 i1
Icetea · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
BU
Buddy E4B v2
Buddy · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
JO
JOSIExMistral 7B Instruct v0.2
Josiexmistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
MI
Mistral v0.2 Nexus Internal Knowledge Map 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB