GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3 30B A3B Abliterated
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
QW
OpenYourMind Qwen3.6 35B A3B Kuato DPO Abliterated Uncensored
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen2.5 3B Instruct Abliterated
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M1.9 GB
GGUF
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
QW
Qwen3 VL 8B Instruct Abliterated v2.0
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplayTool use
QW
Qwen2.5 7B Instruct Abliterated v2
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding
QW
Qwen3 VL 8B NSFW Caption V4.5
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Tool useVision
QW
Huihui Qwen3 4B Abliterated v2
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
VI
MN Violet Lotus 12B
Violet · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Qwen2.5 VL 7B Instruct Unredacted MAX
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3 30B A3B Abliterated Erotic
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
GGUF
GO
Goetia 26B A4B v1.7
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
QW
Qwen2.5 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8 27B Uncensored Chinese
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision
QW
Qwen3.8 27B Uncensored Heretic Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
DE
DeepSeek Coder V2 Lite Instruct Abliterated
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
LY
Lythri 4B A2B
Lythri · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GGUF
GL
Huihui GLM 4.7 Flash Abliterated
GLM · mradermacher
Params30B
Context198K
Q4_K_M18.1 GB
GGUF
TA
UI TARS 1.5 7B
Tars · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.6 35B A3B Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GP
OpenAI Gpt Oss 20B Claude 4.5 Opus Heretic Uncensored
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
AR
Artemis 31B v1.2 Abliterix v2
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
ReasoningVision
MI
MiniCPM V 4.7 35B A3B
MiniCPM · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision

Keep browsing