Small GGUF models

91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.

Most downloadedNewestLargestLongest contextSmallest
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
ReasoningVision
QW
Qwen3.5 4B NSFW ARA Heretic Literotica i1
Qwen · Sinbad-The-Sailor
Params4.2B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Huihui Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen 3 8b Heretic
Qwen · DreamFast
Params8.19B
Context40K
Q4_K_M5.0 GB
Coding
GA
GalTransl v4 4B 2601
Galtransl · SakuraLLM
Params4B
Context32K
Smallest2.8 GB
GGUF
MO
MOSS Image Base
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
GGUF
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
Vision
MU
Murasaki 4B v0.3
Murasaki · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
GGUF
FL
flux2 klein 4b uncensored text encoder
Flux · ponpoke
Params4B
Context—
Q4_K_M2.5 GB
Coding
LY
Lythri 7B A4B
Lythri · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
FL
PornMaster Klein 9b
Flux · rectangleworm
Params8.19B
Context256K
Q4_K_M5.0 GB
GGUF
SP
Raptor 0.6 4B
Spark · OsaurusAI
Params4.1B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
LE
lemer
Lemer · lthn
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
ST
StandardOne 8B
Standardone · StandardThinking
Params8.49B
Context256K
Q4_K_M5.2 GB
ReasoningVision
LL
Llama Joycaption Beta One Hf Llava
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Vision
LL
Llama 3 8B Lexi Uncensored
Llama · Orenguteng
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
imajev 9b
Qwen · mindchain
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
Qwen3 4B
Qwen · ggml-org
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
Vision
GE
gemma-4-E4B-it
Gemma · TheStageAI
Params7.46B
Context128K
Q4_K_M4.3 GB
GGUF
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwopus3 5 9B Coder Flash Test2 MTP HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
ST
StartLux-Decision-v1.1-4B-AutoThink
Startlux · startlux-models
Params4.2B
Context256K
Q4_K_M2.7 GB
ReasoningVision
FL
FLUX 3 Image Klein pup Uncensored
Flux · AtomicChat
Params8.95B
Context256K
Smallest0.0 GB
GGUF
QW
Qwen Image 2.1
Qwen · AlperKTS
Params7.12B
Context—
Smallest4.9 GB
GGUF
MI
Ministral 8B Instruct 2410 TEST
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
NU
NuExtract3
Nuextract · numind
Params4.33B
Context256K
Q4_K_M2.8 GB
ReasoningVision
HY
Hy-Mt2-7B
unsloth
Params7.5B
Context256K
Q4_K_M4.6 GB
GGUF
QW
Qwen3.5-9B
Qwen · jc-builds
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF

Other sizes

Keep browsing