Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
DE
DeepSeek R1 Distill Qwen 7B Heretic
DeepSeek · saidutta69
Params7.62B
Context128K
Q4_K_M4.7 GB
RA
X Ray_Alpha
Ray · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
ME
models--automerger--NeuralsynthesisMeliodas-7B
Meliodas · MaziyarPanahi
Params7.24B
Context32K
Q4_K_M4.4 GB
PE
PersonaVLM
Personavlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
HU
Huihui OmniCoder 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
AU
Aura-Uncensored-OAS-8B-L3
Aura · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
Mistral Trismegistus 7B
Mistral · QuantFactory
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen Image 2.1 Turbo Uncensored
Qwen · li1272
Params8.2B
Context256K
Smallest3.3 GB
LL
Llama3 Aloe 8B Alpha
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
SU
Supergemma4 E4B Abliterated
Supergemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.5 9B Deckard Claude DIMOE Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Granite Guardian 4.1 8b
Granite · mrutkows
Params8.38B
Context128K
Q4_K_M5.1 GB
YO
Youri 7b Chat
Youri · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen3 4b Z Image Turbo AbliteratedV1
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2-NT
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
CO
CoT 2.5 i1
Cot · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
LL
LongWriter Llama3.1 8b
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5 4B Unfiltered
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Qwen3.5 4B MiniFantasy
Qwen · Nubinu
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Replete-Coder-Llama3-8B
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5 9B Claude 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
BO
B2 Bophades 9B
Bophades · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Qwen Image 2.1 Uncensored HF
Qwen · NeverWantedJr
Params7.12B
Context—
Q4_K_M4.6 GB
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
FA
Falcon
Falcon · mradermacher
Params8.11B
Context2K
Q4_K_M5.0 GB
PA
pandafish 2 7b 32k
Pandafish · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OP
OpenMia Indo Engineering 7b i1
Openmia · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
LI
LimyQstar 7B slerp
Limyqstar · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB