Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
DeepSeek R1 Distill Qwen 7B Heretic
DeepSeek · saidutta69
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningTool use
RA
X Ray_Alpha
Ray · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
ME
models--automerger--NeuralsynthesisMeliodas-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
PE
PersonaVLM
Personavlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
HU
Huihui OmniCoder 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MI
Mistral Trismegistus 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · li1272
Params8.2B
Context256K
Smallest3.3 GB
CodingVision
LL
Llama3 Aloe 8B Alpha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
SU
Supergemma4 E4B Abliterated
Supergemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Tool use
QW
Qwen3.5 9B Deckard Claude DIMOE Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
GR
Granite Guardian 4.1 8b
Granite · mrutkows
Params8.38B
Context128K
Q4_K_M5.1 GB
Tool use
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 4b Z Image Turbo AbliteratedV1
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2-NT
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
CO
CoT 2.5 i1
Cot · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
LL
LongWriter Llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 4B Unfiltered
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
RoleplayVision
QW
Qwen3.5 4B MiniFantasy
Qwen · Nubinu
Params4.21B
Context256K
Q4_K_M2.7 GB
Roleplay
LL
Replete-Coder-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
CodingTool use
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
QW
Qwen3.5 9B Claude 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
CodingReasoningTool use
BO
B2 Bophades 9B
Bophades · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Qwen Image 2.1 Uncensored HF
Qwen · NeverWantedJr
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
GGUF
PA
pandafish 2 7b 32k
Pandafish · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OP
OpenMia Indo Engineering 7b i1
Openmia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LI
LimyQstar 7B slerp
Limyqstar · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF

Other sizes

Keep browsing