Small GGUF models
91171 GGUF models with roughly 4B to 9B parameters. Sizes run from 3.51B to 9.5B parameters. The longest trained context is 4194304K tokens.
MU
Music Flamingo Hf
Music · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 4B NSFW ARA Heretic Literotica i1
Qwen · Sinbad-The-Sailor
Params4.2B
Context256K
Q4_K_M2.7 GB
QW
Huihui Qwen3.5 9B Abliterated
Qwen · Abiray
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen 3 8b Heretic
Qwen · DreamFast
Params8.19B
Context40K
Q4_K_M5.0 GB
GA
GalTransl v4 4B 2601
Galtransl · SakuraLLM
Params4B
Context32K
Smallest2.8 GB
MO
MOSS Image Base
Moss · unsloth
Params5.08B
Context—
Q4_K_M3.2 GB
VE
UI Venus 2 9B
Venus · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
MU
Murasaki 4B v0.3
Murasaki · mradermacher
Params4.41B
Context32K
Q4_K_M2.7 GB
FL
flux2 klein 4b uncensored text encoder
Flux · ponpoke
Params4B
Context—
Q4_K_M2.5 GB
LY
Lythri 7B A4B
Lythri · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
FL
PornMaster Klein 9b
Flux · rectangleworm
Params8.19B
Context256K
Q4_K_M5.0 GB
SP
Raptor 0.6 4B
Spark · OsaurusAI
Params4.1B
Context1024K
Q4_K_M2.6 GB
LE
lemer
Lemer · lthn
Params4.65B
Context128K
Q4_K_M3.4 GB
ST
StandardOne 8B
Standardone · StandardThinking
Params8.49B
Context256K
Q4_K_M5.2 GB
LL
Llama Joycaption Beta One Hf Llava
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 3 8B Lexi Uncensored
Llama · Orenguteng
Params8B
Context8K
Q4_K_M4.9 GB
QW
imajev 9b
Qwen · mindchain
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 4B
Qwen · ggml-org
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwen3 VL 4B Instruct
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.5 GB
GE
gemma-4-E4B-it
Gemma · TheStageAI
Params7.46B
Context128K
Q4_K_M4.3 GB
QW
Qwen3 4B Abliterated
Qwen · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
QW
Qwopus3 5 9B Coder Flash Test2 MTP HF
Qwen · Jackrong
Params9.2B
Context256K
Q4_K_M5.8 GB
ST
StartLux-Decision-v1.1-4B-AutoThink
Startlux · startlux-models
Params4.2B
Context256K
Q4_K_M2.7 GB
FL
FLUX 3 Image Klein pup Uncensored
Flux · AtomicChat
Params8.95B
Context256K
Smallest0.0 GB
QW
Qwen Image 2.1
Qwen · AlperKTS
Params7.12B
Context—
Smallest4.9 GB
MI
Ministral 8B Instruct 2410 TEST
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
NU
NuExtract3
Nuextract · numind
Params4.33B
Context256K
Q4_K_M2.8 GB
HY
Hy-Mt2-7B
unsloth
Params7.5B
Context256K
Q4_K_M4.6 GB
QW
Qwen3.5-9B
Qwen · jc-builds
Params8.95B
Context256K
Q4_K_M5.7 GB
QW
Huihui Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB