GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Josiefied Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MI
Mistral Scary Story Finetune
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 2 Ataraxy 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
SY
Sydney_Overthinker_13b_HF
Sydney · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
IN
InverseCoder-CL-13B
Inversecoder · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
LL
Llama-3-8B-Irene-v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
QW
Bella Tao Merged Qwen2_5 Coder 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
GE
Gemma 4 26B A4B Preserving Abliteration
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
NO
Nous Capybara 34B
Nous · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
OP
openchat 3.5 i1
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
QW
Qwen3.6 28B REAP
Qwen · mradermacher
Params28.2B
Context256K
Q4_K_M17.3 GB
GGUF
KU
KukulStanta InfinityRP 7B slerp i1
Kukulstanta · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 3 Uncensored_v2 Merged
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.5 Creative 19B A3B REAP
Qwen · mradermacher
Params18.5B
Context256K
Q4_K_M11.4 GB
GGUF
NE
NeoCortex 7B slerp
Neocortex · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
HU
Huihui Hunyuan MT Chimera 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
CL
Claire 7B 0.1
Claire · mradermacher
Params7.22B
Context2K
Q4_K_M5.0 GB
GGUF
WI
WizardMath 7B V1.1 i1
Wizardmath · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DA
danube2-1.8b-Synthia-v1.3
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
GGUF
IC
IceTea21EnergyDrinkRPV13 dpo240 i1
Icetea · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
BU
Buddy E4B v2
Buddy · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
JO
JOSIExMistral 7B Instruct v0.2
Josiexmistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mistral v0.2 Nexus Internal Knowledge Map 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Keep browsing