Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Viggle Qwen Image 2.1 Turbo GGUFs
Qwen · realrebelai
Params7.12B
Context—
Q4_K_M5.6 GB
GGUF
GE
Gemma The Writer Mighty Sword 9B
Gemma · DavidAU
Params9.2B
Context8K
Q4_K_M5.6 GB
Roleplay
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3.5 4B Claude 3xMerge Jackrong UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use
MI
MiniCPM o 2 6
MiniCPM · openbmb
Params7.6B
Context32K
Q4_K_M4.7 GB
Vision
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
JA
japanese stablelm instruct beta 7B
Japanese · TheBloke
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Qwen Image 2.1 Uncensored
Qwen · ldov
Params7.12B
Context—
Q4_K_M4.6 GB
GGUF
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Q4_K_M2.5 GB
Vision
OP
openchat_openchat-3.5-1210
Openchat · TheBloke
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
AE
AesCode 8B
Aescode · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Coding
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · kamjin
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
LL
LLaMA Mesh
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
Vision
AE
AesCode 8B
Aescode · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
CodingVision
JA
Jan-nano-128k
Jan · Menlo
Params4B
Context128K
Q4_K_M2.5 GB
GGUF
PH
Phi 3 mini 128k instruct
Phi · QuantFactory
Params3.82B
Context128K
Q4_K_M2.4 GB
Coding
DE
DeepSeek R1 Distill Qwen 7B Abliterated v2
DeepSeek · Melvin56
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
QW
Qwen3 VL Embedding 8B
Qwen · mradermacher
Params7.57B
Context256K
Q4_K_M4.7 GB
EmbeddingVision
OP
openbuddy_openbuddy-zephyr-7b-v14.1
Openbuddy · TheBloke
Params7.28B
Context32K
Q4_K_M4.4 GB
GGUF
CH
AA Chameleon 7b Plus
Chameleon · mradermacher
Params7B
Context4K
Q4_K_M4.3 GB
GGUF
QW
Qwen3 4b Z Image Engineer V4
Qwen · BennyDaBall
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
SU
Sulphur 2 Prompt Enhancer Uncensored
Sulphur · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwopus3.5 9B v3
Qwen · Jackrong
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningVision
QW
Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Roleplay
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · nyan-ame
Params7.6B
Context32K
Q4_K_M4.7 GB
Coding
ZW
ZwZ2 4B
Zwz · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use

Other sizes

Keep browsing