Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Atomic Chat / Qwen3 4B DFlash
Qwen · AtomicChat
Params537M
Context40K
Smallest0.6 GB
QW
Atomic Chat / Qwen3.5 9B DFlash
Qwen · AtomicChat
Params1.29B
Context256K
Smallest1.4 GB
QW
Qwen3.6 35B A3B DFlash GGUF llama.cpp
Qwen · Alittlehammmer
Params386M
Context256K
Q4_K_M0.2 GB
BG
bge reranker v2 m3
BGE · gpustack
Params568M
Context8K
Q4_K_M0.4 GB
MI
Ministral-3-3B-Instruct-2512
Mistral · unsloth
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · bartowski
Params1.54B
Context4K
Q4_K_M1.0 GB
LF
LFM2.5 VL 1.6B
Lfm · ente-ai
Params1.17B
Context125K
Q4_K_M0.7 GB
JE
JevK5
Jevk · alibiserikbay
Params1.88B
Context256K
Q4_K_M2.7 GB
VO
VoxCPM2
Voxcpm · DennisHuang648
Params912M
Context32K
Smallest1.7 GB
OR
Ornith 1.0 35B Heretic MTP APEX
Ornith · SC117
Params447M
Context—
Smallest0.2 GB
QW
Qwen3 ASR 0.6B
Qwen · unslothai
Params752M
Context64K
Smallest0.8 GB
PA
Parakeet TDT 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
LF
LFM2.5 1.2B Instruct
Lfm · bartowski
Params1.17B
Context125K
Q4_K_M0.7 GB
TI
TIPO 500M
Tipo · KBlueLeaf
Params508M
Context2K
Smallest1.0 GB
SM
smollm2 360m aac watch
SmolLM · dcostenco
Params362M
Context8K
Smallest0.2 GB
MU
multilingual e5 large instruct
Multilingual · Ralriki
Params559M
Context512
Q4_K_M0.4 GB
SE
SenseVoice Small
Sensevoicesmall · handy-computer
Params234M
Context—
Q4_K_M0.1 GB
LF
LFM2.5 VL 450M
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
BI
bitnet b1.58 2B 4T
Bitnet · microsoft
Params2.41B
Context4K
Smallest1.2 GB
QW
Qwen3.8 Flash Next Uncensored
Qwen · AtomicChat
Params80M
Context256K
Q4_K_M93.9 GB
TI
TinyMistral 248M v2 Instruct
Tinymistral · M4-ai
Params248M
Context32K
Q4_K_M0.2 GB
DA
DanTagGen delta rev2
Dantaggen · KBlueLeaf
Params393M
Context2K
Smallest0.3 GB
LA
Laya
Laya · ggml-org
Params421M
Context8K
Smallest0.4 GB
QW
Qwen3 0.6b Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
MI
mistralai_Ministral 3 3B Instruct 2512 BF16
Mistral · lmstudio-community
Params3.43B
Context256K
Q4_K_M2.1 GB
ST
stable diffusion 3.5 large
Stable · second-state
Params695M
Context—
Smallest0.7 GB
JI
JiRackUltra 1b
Jirackultra · CMSManhattan
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen3 VL 2B Instruct
Qwen · ggml-org
Params1.72B
Context256K
Smallest1.8 GB
QW
Qwen3.8-27B-DFlash2
Qwen · incoai
Params1.92B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.8 Flash Next abliterated GGUF IQ4XS
Qwen · wy2pay
Params53M
Context—
Smallest0.2 GB