Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
OM
OmniASR-LLM-300M
Omniasr · cstr
Params1.63B
Context—
Smallest1.1 GB
GGUF
RW
rwkv7 g1h 2.9b i1
Rwkv · RemySkye
Params2.95B
Context1024K
Q4_K_M2.1 GB
GGUF
LF
LFM2.5 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
GGUF
LL
Deep Reasoning Llama 3.2 Dolphin3.0 3B i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Reasoning
QW
Nemotron Research Reasoning Qwen 1.5B
Qwen · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
LL
Llm Jp 3 1.8b
Llm · mmnga
Params1.87B
Context4K
Q4_K_M1.2 GB
GGUF
QW
Qwen 2.5 3b RP i1
Qwen · mradermacher
Params3.4B
Context32K
Q4_K_M2.1 GB
Roleplay
LL
MiniThinky v2 1B Llama 3.2
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
AR
arco reflection v4
Arco · mradermacher
Params514M
Context8K
Q4_K_M0.3 GB
GGUF
MI
midjourney prompt improver lora model
Midjourney · jzdesign
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
DA
danube2-1.8b-Neural
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
GGUF
PA
parakeet tdt 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
GGUF
LF
LFM2.5 VL 3B
Lfm · bartowski
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
QW
Qwen 2.5 3b Decensored
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
FI
v6 Finch 3B HF
Finch · bartowski
Params3.1B
Context1024K
Q4_K_M1.9 GB
GGUF
QW
Huihui Qwen3 VL 2B Thinking Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
ReasoningVision
NE
NeuTTS Air
Neutts · BricksDisplay
Params262M
Context—
Q4_K_M0.3 GB
GGUF
EM
xVITA Embed2 zhTW
Embeddinggemma · xCloudinfo
Params271M
Context256K
Q4_K_M0.2 GB
EmbeddingVision
FL
Flux Prompt Enhance
Flux · mradermacher
Params223M
Context512
Q4_K_M0.1 GB
GGUF
VI
VibeThinker 3B
Vibethinker · prithivMLmods
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingReasoning
FL
flux dev
Flux · gguf-org
Params123M
Context—
Q4_K_M6.7 GB
GGUF
QW
ISO42001 Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Smallest1.0 GB
GGUF
KO
kokoro
Kokoro · mmwillet2
Params88M
Context—
Smallest0.2 GB
GGUF
CO
codegemma-2b
Codegemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
DO
dopeystableplats 3b v1
Dopeystableplats · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
YZ
yzma tests
Yzma · deadprogram
Params19M
Context8K
Smallest0.0 GB
GGUF
TI
TinySlime-1.1B-Chat-v1.0
Tinyslime · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
LF
LFM2.5 1.2B Instruct heretic
Lfm · saidutta69
Params1.17B
Context125K
Q4_K_M0.7 GB
ReasoningRoleplayTool use

Other sizes

Keep browsing