GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
ZA
Zaire 12B v0.1
Zaire · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 4 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Huihui Qwen3.6 35B A3B Claude 4.7 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningVision
GE
Gemma 4 E4B It Apostate
Gemma · mradermacher
Params8.13B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
QI
QiMing Holos Plus 8B
Qiming · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
NO
North Mini Code 1.0 Uncensored Heretic
North · mradermacher
Params30.5B
Context488K
Q4_K_M18.6 GB
Coding
LL
samantha-dolphin-llama-3
Llama · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
HE
Hemmingway 1 Heretic MTP V3 Final
Hemmingway · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Reasoning
YO
Youri 7b Instruction
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
LL
CodeLlama 70b Python Hf
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Coding
CH
Chronos Gold 12B 1.0 i1
Chronos · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
KO
Kohlibri 40B
Kohlibri · mradermacher
Params40.3B
Context256K
Q4_K_M24.5 GB
ReasoningTool use
MI
dolphin 2.2.1 mistral 7b i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ZO
Zorka Vieniera 12b
Zorka · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
GGUF
SK
Skyfall 31B v4.2 Abliterix
Skyfall · mradermacher
Params31.4B
Context128K
Q4_K_M19.0 GB
GGUF
MI
Dolphin Mistral GLM 4.7 Flash 24B Venice Edition Thinking Uncensored
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
ReasoningRoleplay
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
CO
ConfigurableBeagle 11B i1
Configurablebeagle · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
ME
Meltemi 7B v1.5
Meltemi · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
GGUF
OP
openbuddy-zen-56b-v21.2-32k
Openbuddy · mradermacher
Params56.7B
Context128K
Q4_K_M34.0 GB
GGUF
QW
Qwen3 Coder 30B A3B Instruct Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
PH
Phonellm Mini Alpha 2
Phonellm · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
Tool use
LL
Nous Hermes Llama2 70b i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
CO
ConfigurableHermes 7B i1
Configurablehermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplayVision
MI
Mistral Medium 3.5 128B Eschaton Uncensored
Mistral · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
Reasoning
QW
Qwen3 30B A3B Gemini Pro High Reasoning 2507 ABLITERATED UNCENSORED
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Reasoning
QW
Huihui Qwen3 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
ST
stable-code-instruct-3b
Stable · mradermacher
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding

Keep browsing