GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.6 35B A3B StyleTune
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Roleplay
GR
granite-8b-code-instruct
Granite · mradermacher
Params8.05B
Context4K
Q4_K_M4.9 GB
CodingTool use
BA
bagel dpo 20b v04
Bagel · mradermacher
Params19.9B
Context32K
Q4_K_M12.7 GB
CodingRoleplayTool use
LL
Llama-3-Luminurse-v0.1-OAS-8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ZE
Zen Voyager
Zen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
TR
Trion-M-7b
Trion · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GP
GPT4chan 8B
Gpt · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MO
MoNeuTrix MoE 4x7B
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
GE
Huihui Gemma 4 12B Agentic Fable5 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
QW
Qwen3.6 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
QW
Qwen2.5 7B Instruct 1M Thinking Claude Gemini GPT5.2 DISTILL
Qwen · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
ReasoningRoleplay
GL
GLM 4.6V Flash
GLM · mradermacher
Params9.4B
Context128K
Q4_K_M6.2 GB
ReasoningTool useVision
QW
Qwen3.8 27B RANA Abliterated
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
RA
Radon 35B Ultra X RU
Radon · mradermacher
Params30.5B
Context64K
Q4_K_M18.6 GB
GGUF
MI
Mixtral 8x7B v0.1 i1
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
HE
HelpingAI-9B
Helpingai · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
GGUF
NS
NSK 128k 7B slerp
Nsk · mradermacher
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
GP
Gpt Oss 20b Tainted Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
MI
dolphin-2.9.3-mistral-7B-32k
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
CodingTool use
LL
CodeLlama 7b CypherGen
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.2 GB
Coding
TE
Tev 27B
Tev · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MI
Ministral-3-14B-Nymphaea-RP
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Roleplay
QQ
qqWen 32B Pretrain
Qqwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.5 27B Uncensored Heretic v1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
HO
Holo4 27B
Holo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
OP
OpenChat 3.5 7B Starling v2.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF

Keep browsing