GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
TR
TripleTrouble
Tripletrouble · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
Tool use
SA
SauerkrautLM 7b LaserChat
Sauerkrautlm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Qwen3.5 9B The Bradbury F451 Pro Writer Uncensored Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingRoleplay
CH
ChatLaw2E_plain_7B
Chatlaw · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
Vision
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
Vision
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
VE
UI Venus 1.5 30B A3B
Venus · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
YI
Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
GGUF
QW
QWQ_Zero1
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
Reasoning
DI
Sf Diogenes v0.1
Diogenes · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Vision
MA
MAmmoTH2-8B-Plus
Mammoth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
llama2 7b chat uncensored i1
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
QW
Qwen3.8 Flash Coder CYBER Heretic
Qwen · mradermacher
Params42.6B
Context256K
Q4_K_M28.4 GB
CodingReasoningTool use
HA
MN HaremUnion 12B i1
Haremunion · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GL
Glistening Gem 31B v2.1
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
RI
Riva Translate 4B Instruct v1.1
Riva · mradermacher
Params4.18B
Context8K
Q4_K_M2.8 GB
GGUF
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Qwen3.5 27B Claude 4.6 OS Auto Variable Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ReasoningRoleplay
MI
Mixtral AI Cyber 5.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen3 VL 4B Instruct Heretic
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
MI
Ministral 3 8B Reasoning 2512 It
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningTool use
YI
Faro Yi 34B DPO
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
GGUF
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
Vision
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
Vision

Keep browsing