GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 14B Abliterated v2
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 14B Uncensored
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
Reasoning
GP
Gpt Oss 120b Uncensored
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
Reasoning
QW
Qwen2.5 7B Instruct Uncensored
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LA
latxa-13b-v1.2
Latxa · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
HO
K2 Horizon 7B Heretic
Horizon · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GGUF
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.8 27B OBLITERATED
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
LL
Dolphin3.0 Llama3.1 8B Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
TO
Torchcast Decision 12b
Torchcast · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
ME
G4 MeroMero v2 31B Heretic
Meromero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
LU
LunaraHome 26B A4B
Lunarahome · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Tool use
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
HA
Harrier Oss v1 0.6b
Harrier · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.8 9B Distill Uncensored Heretic
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Qwen2.5 VL 3B Instruct
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
QW
Qwen3 32B Uncensored
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3 VL 8B Heretic Stable
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
HO
K2-Horizon-MoVA-36B-A4B
Horizon · mradermacher
Params37.4B
Context512K
Q4_K_M22.4 GB
GGUF
QW
Qwen3 8B Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.5 9B Coder
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
ST
StartLux Decision 35B A3B
Startlux · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Qwen3.8 9B Heretic Uncensored
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8 27B Heretic JP Roleplay NSFW
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Roleplay
AG
Agri 31b v1
Agri · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
LL
Llama 3.2 1B Instruct Uncensored
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Qwen3.8 27B Fable Distill Heretic Ara
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
GGUF
LL
Phind CodeLlama 34B v2
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
Coding

Keep browsing