GGUF models by mradermacher
71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.
MI
Mixtral AI DeepMedicalMind
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
starcoder2-15b-instruct-v0.1
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
HE
Hebrew_Nemo
Hebrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MO
Dreamaiai 27B 03
Moon · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
RD
RDT2 VQ
Rdt · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
MU
music generation model
Music · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
ReflectionCoder-DS-6.7B
Reflectioncoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
UN
UNAversal 8x7B v1beta i1
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
QW
Qwen3.5 9B Heretic Ara v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 VL 8B Instruct Unredacted MAX
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GE
Gemma 3 4b It Uncensored DBL X
Gemma · mradermacher
Params4.26B
Context128K
Q4_K_M2.7 GB
LL
Meta Llama 3.1 Chat Uncensored i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
ED
Eduardo 27b
Eduardo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SU
SuperGemma 4 12b Abliterated
Supergemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
QW
Qwen3.5 9B Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
HE
Hermes 4 14B OBLITERATED V2
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
SP
Spark X2.6 4B Heretic
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B i1
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
MI
Young Children Storyteller Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
KA
KangalKhan RawRuby 7B i1
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MO
MonarchPipe 7B slerp
Monarchpipe · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
FI
Fino1 8B
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
YI
Yi-6B-200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
OL
Olmo 3 7B Instruct DPO
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
IN
Index Translate 9B
Index · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB