GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
TR
TripleTrouble
Tripletrouble · mradermacher
Params34.7B
Context32K
Q4_K_M21.2 GB
SA
SauerkrautLM 7b LaserChat
Sauerkrautlm · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen3.5 9B The Bradbury F451 Pro Writer Uncensored Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CH
ChatLaw2E_plain_7B
Chatlaw · mradermacher
Params7.74B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.6 35B A3B Uncensored Heretic Native MTP Preserved
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3 VL 32B Instruct Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
QW
Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
VE
UI Venus 1.5 30B A3B
Venus · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
YI
Yi 34B
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
MP
Mpt 30b Instruct
Mpt · mradermacher
Params30B
Context8K
Q4_K_M19.1 GB
QW
QWQ_Zero1
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
DI
Sf Diogenes v0.1
Diogenes · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
MI
Codestral 22B v0.1
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
QW
Qwen3.8 27B Uncensored Heretic v3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MA
MAmmoTH2-8B-Plus
Mammoth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
llama2 7b chat uncensored i1
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GA
GaMS3 12B Multimodal
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.8 Flash Coder CYBER Heretic
Qwen · mradermacher
Params42.6B
Context256K
Q4_K_M28.4 GB
HA
MN HaremUnion 12B i1
Haremunion · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GL
Glistening Gem 31B v2.1
Glistening · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RI
Riva Translate 4B Instruct v1.1
Riva · mradermacher
Params4.18B
Context8K
Q4_K_M2.8 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
Qwen3.5 27B Claude 4.6 OS Auto Variable Heretic Uncensored Thinking
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
MI
Mixtral AI Cyber 5.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Qwen3 VL 4B Instruct Heretic
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
MI
Ministral 3 8B Reasoning 2512 It
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
YI
Faro Yi 34B DPO
Yi · mradermacher
Params34.4B
Context32K
Q4_K_M20.7 GB
MI
Mistral Small 4 119B 2603
Mistral · mradermacher
Params119B
Context1024K
Q4_K_M72.2 GB
QW
Qwen2.5 VL 32B Instruct Unredacted MAX
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB