GGUF models by mradermacher

71763 GGUF models quantized by mradermacher on Hugging Face. Sizes run from 2M to 673B parameters. The longest trained context is 10742K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
LL
Huihui Mistral Small 3.2 24B Instruct 2506 Abliterated Llamacppfixed
Llama · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
FA
FashionGPT 70B V1.1 i1
Fashiongpt · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
VI
VibeThinker 3B
Vibethinker · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoning
QW
Qwen3.5 9B Claude Fable 5xMerge
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoning
GO
Goetia 26B A4B v1.3 Absolute Heretic ARA
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
GE
Gemma 4 E4B It Erotica
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
KU
Kunokukulemonchini 7b
Kunokukulemonchini · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
TO
TooManyMixRolePlay-7B-Story_V3.5
Toomanymixroleplay · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
QW
Ministral 3 3B Qwen3.8 Max Reasoning Distilled
Qwen · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningTool use
AE
Aetheria L2 70B i1
Aetheria · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
WE
WeVisOne VL 4B
Wevisone · mradermacher
Params4.42B
Context256K
Q4_K_M2.7 GB
Tool useVision
NO
Noema 1.5 4B Fast
Noema · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CodingReasoning
CY
CyberStag Security 26B A4B V1 Uncensored Heretic
Cyberstag · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
MI
TowerInstruct Mistral 7B v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PY
Pythia 410m
Pythia · mradermacher
Params405M
Context2K
Q4_K_M0.3 GB
GGUF
NO
Nock Coder 1.5b
Nock · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
LL
Humanish Roleplay Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
NE
Neuralgamma 2.5 7B slerp
Neuralgamma · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Tool use
QW
Qwen3.8 4B Agentic Distill
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
FR
FrogNano 4B 2609
Frognano · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
GGUF
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
ED
EduMixtral 4x7B i1
Edumixtral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
QW
Qwen3 VL Reranker 2B
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
EmbeddingTool useVision
MI
Mahou-1.2a-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
14B Qwen2.5 Kunou v1
Qwen · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GGUF
CH
Chiboard 1.1 0.8b
Chiboard · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
HE
HERO 4B
Hero · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF

Keep browsing