Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
QW
Viggle Qwen Image 2.1 Turbo GGUFs
Qwen · realrebelai
Params7.12B
Context—
Q4_K_M5.6 GB
GE
Gemma The Writer Mighty Sword 9B
Gemma · DavidAU
Params9.2B
Context8K
Q4_K_M5.6 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 4B Claude 3xMerge Jackrong UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
MiniCPM o 2 6
MiniCPM · openbmb
Params7.6B
Context32K
Q4_K_M4.7 GB
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
JA
japanese stablelm instruct beta 7B
Japanese · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
QW
Qwen Image 2.1 Uncensored
Qwen · ldov
Params7.12B
Context—
Q4_K_M4.6 GB
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Q4_K_M2.5 GB
OP
openchat_openchat-3.5-1210
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
AE
AesCode 8B
Aescode · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · kamjin
Params7.5B
Context128K
Q4_K_M5.3 GB
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
AE
AesCode 8B
Aescode · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
JA
Jan-nano-128k
Jan · Menlo
Params4B
Context128K
Q4_K_M2.5 GB
PH
Phi 3 mini 128k instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · Melvin56
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen3 VL Embedding 8B
Qwen · mradermacher
Params7.57B
Context256K
Q4_K_M4.7 GB
OP
openbuddy_openbuddy-zephyr-7b-v14.1
Openbuddy · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
CH
AA Chameleon 7b Plus
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
QW
Qwen3 4b Z Image Engineer V4
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
SU
Sulphur 2 Prompt Enhancer Uncensored
Sulphur · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwopus3.5 9B v3
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · nyan-ame
Params7.6B
Context32K
Q4_K_M4.7 GB
ZW
ZwZ2 4B
Zwz · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB