Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
LL
Llm Jp 4.1 8b Thinking
Llm · llm-jp
Params8.59B
Context64K
Q4_K_M5.5 GB
QW
Qwen3 gabliterated image generation
Qwen · goonsai-com
Params4B
Context256K
Q4_K_M2.5 GB
GR
Granite-4.1-8B
Granite · unsloth
Params8.79B
Context128K
Q4_K_M5.3 GB
SE
Seed-Coder-8B-Reasoning
Seed · unsloth
Params8.25B
Context64K
Q4_K_M5.1 GB
QW
Qwen3.5 9B Heretic Ara v1
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
gemma4 E2B it qat Q4 unsloth heretic
Gemma · MobiusDevelopment
Params4.63B
Context128K
Q4_K_M3.4 GB
SP
Spark X2.6 4B
Spark · abenzerps
Params4.11B
Context1024K
Q4_K_M2.6 GB
LL
Linux Meta Llama
Llama · yun2022
Params8.03B
Context128K
Smallest8.5 GB
GA
GameScaling 9B S3
Gamescaling · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
gemma 4 E4B it heretic
Gemma · saidutta69
Params7.46B
Context128K
Q4_K_M5.3 GB
QW
Qwen3.5 text 9B NSFW RP RolePlay
Qwen · DGDGDG12
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · Kondara
Params7.62B
Context32K
Q4_K_M4.7 GB
AR
Arctic Text2SQL R1 7B
Arctic · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama xLAM 2 8b Fc R
Llama · Salesforce
Params8B
Context128K
Q4_K_M4.9 GB
GR
Granite 8b Code Base 128k
Granite · mradermacher
Params8.05B
Context125K
Q4_K_M4.9 GB
HO
K2 Horizon 7B Uno Uncensored
Horizon · geantendormi
Params9B
Context512K
Smallest5.1 GB
FL
flux2 klein adreno
Flux · zhiyuanasad
Params3.88B
Context—
Smallest2.3 GB
QW
Qwen3.8 9B Abliterated 25
Qwen · MegaPanchamZ
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Huihui Qwen3 VL 4B Instruct Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
FL
FLUX.2 klein base 9B
Flux · leejet
Params9.08B
Context—
Smallest5.6 GB
QW
Qwen3 8b Abliterated
Qwen · richardyoung
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3.5 9B
Qwen · gguf
Params9.2B
Context256K
Q4_K_M6.2 GB
QW
Qwen3 VL 8B Abliterated Caption It
Qwen · prithivMLmods
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 7B
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
Llama3-Chinese-8B-Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.5 4B Uncensored
Qwen · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
LF
LFM2 8B A1B
Lfm · LiquidAI
Params8.34B
Context125K
Q4_K_M5.0 GB
MI
MiMo Negentropy 9B AGSI
Mimo · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
KR
Kronumos Kairos v2
Kronumos · bartowski
Params7.6B
Context32K
Q4_K_M4.8 GB