GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
QW
Qwen2.5 72B Instruct Abliterated
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
DE
DeepSeek R1 Distill Qwen 7B Uncensored
DeepSeek · mradermacher
Params7.61B
Context128K
Q4_K_M4.7 GB
ME
Merotheon 31B
Merotheon · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
MA
MangaLMM
Mangalmm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ZA
Zawen v0.1 35B A3B
Zawen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
CL
Clef Flash Heretic
Clef · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
OR
Ornith 1.5 35B A3B MTP
Ornith · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
QW
Qwen3.5 27B Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
HY
Hy MT2 1.8B
mradermacher
Params1.79B
Context256K
Q4_K_M1.1 GB
YI
Yi 34B 200K DARE megamerge v8 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
VE
Veloxy Titan 32B
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
PY
Pyrex 8B Instruct Uncensored i1
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
JE
Jeffan 31b 1710
Jeffan · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GU
GUI Owl 1.5 4B Instruct
Gui · mradermacher
Params4B
Context32K
Q4_K_M2.5 GB
AS
Asmodeus 24B v3
Asmodeus · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Qwen3.8 35B A3B Distill
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
GD
GDP 4B
Gdp · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
HO
K2 Horizon 32B Heretic
Horizon · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
YI
ChatAllInOne-Yi-34B-200K-V1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
SA
Sage A1.5
Sage · mradermacher
Params35.5B
Context256K
Q4_K_M21.7 GB
CO
Yi Coder 9B Chat
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
SH
Shadow Siren 14B Pruned
Shadow · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Huihui Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
OrionStar-Yi-34B-Chat-Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB