GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
NE
Nekomata 14b Instruction
Nekomata · mradermacher
Params14.2B
Context8K
Q4_K_M9.4 GB
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
QW
UwU Qwen3.5 27B v0.1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ZE
Zen4 Coder
Zen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
SW
Swallow MX 8x7b NVE v0.1
Swallow · mradermacher
Params46.7B
Context4K
Q4_K_M28.4 GB
MI
Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
Mistral · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
RO
Rocinante X 12B v1 Heretic Uncensored
Rocinante · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
AV
Average_Normie_v3.69_8B
Average · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 E4B Abliterated Uncensored
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
NU
NuMarkdown-8B-Thinking
Numarkdown · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
WR
Wraith 8b
Wraith · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
cyber risk llama 3 8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 2B GPT 5.1 HighIQ INSTRUCT
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
MU
Muslim 6B v3
Muslim · mradermacher
Params5.94B
Context256K
Q4_K_M3.7 GB
GE
Gemma 4 E4B It GMCE
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
ST
MN 12B Starcannon v1 i1
Starcannon · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
DQ
dqnMath v1
Dqnmath · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
LL
Infinity-Instruct-3M-0613-Llama3-70B
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
PY
Pyrz 8B Instruct Uncensored i1
Pyrz · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OZ
Ozyvler Ozygram Neural 7B Coder MCTS
Ozyvler · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
QW
Qwen3 Esper3 Reasoning CODER Instruct 12B Brainstorm20x
Qwen · mradermacher
Params11.9B
Context40K
Q4_K_M7.2 GB
QW
Qwen3 VL 12B Instruct Brainstorm20x
Qwen · mradermacher
Params11.9B
Context256K
Q4_K_M7.2 GB
KA
Karnak
Karnak · mradermacher
Params40.7B
Context256K
Q4_K_M24.7 GB
OP
OpenELM 450M Instruct
Openelm · mradermacher
Params457M
Context2K
Q4_K_M0.3 GB
DE
Ph3della 14B i1
Della · mradermacher
Params14B
Context4K
Q4_K_M8.6 GB
LO
Loopl Vl 4b
Loopl · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
HO
Holo2 235B A22B
Holo · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
EU
EuroLLM 9B MeditronFO
Eurollm · mradermacher
Params9.15B
Context4K
Q4_K_M5.6 GB
ME
Medra27B
Medra · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB