Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Llm Jp 4.1 8b Thinking
Llm · llm-jp
Params8.59B
Context64K
Q4_K_M5.5 GB
Reasoning
QW
Qwen3 gabliterated image generation
Qwen · goonsai-com
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
GR
Granite-4.1-8B
Granite · unsloth
Params8.79B
Context128K
Q4_K_M5.3 GB
GGUF
SE
Seed-Coder-8B-Reasoning
Seed · unsloth
Params8.25B
Context64K
Q4_K_M5.1 GB
CodingReasoning
QW
Qwen3.5 9B Heretic Ara v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GE
gemma4 E2B it qat Q4 unsloth heretic
Gemma · MobiusDevelopment
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
SP
Spark X2.6 4B
Spark · abenzerps
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
LL
Linux Meta Llama
Llama · yun2022
Params8.03B
Context128K
Smallest8.5 GB
GGUF
GA
GameScaling 9B S3
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
GE
gemma 4 E4B it heretic
Gemma · saidutta69
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
QW
Qwen3.5 text 9B NSFW RP RolePlay
Qwen · DGDGDG12
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwen2.5 Coder 7B Instruct
Qwen · Kondara
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
AR
Arctic Text2SQL R1 7B
Arctic · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
Tool use
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
HO
K2 Horizon 7B Uno Uncensored
Horizon · geantendormi
Params9B
Context512K
Smallest5.1 GB
GGUF
FL
flux2 klein adreno
Flux · zhiyuanasad
Params3.88B
Context—
Smallest2.3 GB
GGUF
QW
Qwen3.8 9B Abliterated 25
Qwen · MegaPanchamZ
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
Vision
FL
FLUX.2 klein base 9B
Flux · leejet
Params9.08B
Context—
Smallest5.6 GB
GGUF
QW
Qwen3 8b Abliterated
Qwen · richardyoung
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
QW
Qwen3.5 9B
Qwen · gguf
Params9.2B
Context256K
Q4_K_M6.2 GB
Vision
QW
Qwen3 VL 8B Abliterated Caption It
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
QW
Qwen2.5 Coder 7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
LL
Llama3-Chinese-8B-Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3.5 4B Uncensored
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningTool useVision
LF
LFM2 8B A1B
Lfm · LiquidAI
Params8.34B
Context125K
Q4_K_M5.0 GB
GGUF
MI
MiMo Negentropy 9B AGSI
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
KR
Kronumos Kairos v2
Kronumos · bartowski
Params7.6B
Context32K
Q4_K_M4.8 GB
Coding

Other sizes

Keep browsing