GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mixtral AI DeepMedicalMind
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
ST
starcoder2-15b-instruct-v0.1
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
Coding
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
HE
Hebrew_Nemo
Hebrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MO
Dreamaiai 27B 03
Moon · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
RD
RDT2 VQ
Rdt · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
Vision
MU
music generation model
Music · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RE
ReflectionCoder-DS-6.7B
Reflectioncoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
UN
UNAversal 8x7B v1beta i1
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
QW
Qwen3.5 9B Heretic Ara v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool useVision
QW
Qwen3 VL 8B Instruct Unredacted MAX
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
GE
Gemma 3 4b It Uncensored DBL X
Gemma · mradermacher
Params4.26B
Context128K
Q4_K_M2.7 GB
Roleplay
LL
Meta Llama 3.1 Chat Uncensored i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
ED
Eduardo 27b
Eduardo · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
SU
SuperGemma 4 12b Abliterated
Supergemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
LL
CodeLlama 13b Python Hf
Llama · mradermacher
Params13B
Context16K
Q4_K_M7.9 GB
Coding
QW
Qwen3.5 9B Heretic v2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
HE
Hermes 4 14B OBLITERATED V2
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
SP
Spark X2.6 4B Heretic
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
PH
dolphin-2.9.2-Phi-3-Medium-abliterated
Phi · mradermacher
Params14B
Context4K
Q4_K_M8.4 GB
CodingTool use
DE
Qwen2.5 MOE 2X7B DeepSeek Abliterated UNCensored 19B i1
DeepSeek · mradermacher
Params19B
Context128K
Q4_K_M11.6 GB
ReasoningTool use
MI
Young Children Storyteller Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
KA
KangalKhan RawRuby 7B i1
Kangalkhan · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MO
MonarchPipe 7B slerp
Monarchpipe · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
FI
Fino1 8B
Fino · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
YI
Yi-6B-200K
Yi · mradermacher
Params6.06B
Context195K
Q4_K_M3.7 GB
GGUF
OL
Olmo 3 7B Instruct DPO
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Reasoning
IN
Index Translate 9B
Index · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF

Keep browsing