GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Qwen3 30B A3B Instruct 2507 Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
Llama 3.1 WhiteRabbitNeo 2 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3.1 8B Instruct Heretic V1 1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GE
GEITje 7b Uncensored
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
HU
HuatuoGPT 3 27B
Huatuogpt · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SE
Securecoder 30b Pro v2 Merged
Securecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GO
Goetia 26B A4B v1.6
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
MI
Ministral 3 3B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
NE
NVIDIA Nemotron Nano 9B v2 Japanese
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
CH
Chocolatine 3B Instruct DPO v1.0 i1
Chocolatine · mradermacher
Params3.82B
Context4K
Q4_K_M2.4 GB
TE
Teknofest 2025 Turkish Edu v2
Teknofest · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
WA
WaifuGemma4 26b A4B v1
Waifugemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 E2B
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
LF
LFM2 24B A2B REAP
Lfm · mradermacher
Params12.4B
Context125K
Q4_K_M7.5 GB
QW
Qwen2.5 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
OLMo-1.7-7B-hf
OLMo · mradermacher
Params6.89B
Context4K
Q4_K_M4.2 GB
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
IN
InternVL3_5 8B
Internvl · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
NO
Novel Humanize 4b
Novel · mradermacher
Params4.02B
Context40K
Q4_K_M2.5 GB
TO
ToolSpace 8B
Toolspace · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
TI
TinyLlama-1.1B-DavidAttenborough
Tinyllama · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
KO
Konstanta V4 Alpha 7B
Konstanta · mradermacher
Params7.24B
Context8K
Q4_K_M4.5 GB
GR
MN GRAND Gutenberg Lyra4 Lyra 12B DARKNESS
Grand · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
SE
Securecoder 30b Pro v3 Merged
Securecoder · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
LL
CodeLlama 34b Python Hf
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen3.6 35B A3B Brainwaves Nex Uncensored
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
MI
Huihui MiniCPM V 4.6 Thinking Abliterated
MiniCPM · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB