GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
LU
G4 LuneLight 31B
Lunelight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
AR
Artemis 31B v1.2 Abliterix
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
KI
Kimi VL A3B Instruct
Kimi · mradermacher
Params16B
Context128K
Q4_K_M10.5 GB
Vision
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen2.5 Vl 7b Cam Motion
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
KI
Kitchoon 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
WI
Wicked Stuff 26B A4B Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
QW
Qwen3.8 27B Optimal Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
EU
EuroLLM 1.7B Instruct
Eurollm · mradermacher
Params1.66B
Context8K
Q4_K_M1.0 GB
GGUF
GU
GUI Owl 1.5 8B Instruct
Gui · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Vision
QW
Huihui Qwen3.5 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
SW
Swish 26B A4B Final
Swish · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
QW
Qwen3.8 27B Antislop
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
PY
Pythia 6.9b
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
GP
Gpt Oss 120b Abliterated
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
GGUF
BI
Biomni R0 32B Preview
Biomni · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
Coding
LF
LFM2.5 24B A2B
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
GGUF
WI
Wicked Stuff 31B Final
Wicked · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
QW
Qwen3.5 122B A10B Abliterated v1
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
QW
Qwen2.5 Coder 32B Instruct 3MPER0RR Abliterated
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
HE
HERO 9B
Hero · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
SP
Split Untied 31B
Split · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
QW
Qwen3 VL 8B NSFW Caption V4.5 Heretic
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
GE
Writer
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
ST
Dolphincoder Starcoder2 15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
CodingTool use
OV
OvisOCR3
Ovisocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
Gemma 4 Dark Orthia Untied 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningTool use
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision

Keep browsing