Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
TI
TiamaPY-1.1B-v24
Tiamapy · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
LL
llama 3.2 3b chat doctor i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LO
LocutusqueXFelladrin TinyMistral248M Instruct
Locutusquexfelladrin · afrideva
Params248M
Context32K
Q4_K_M0.2 GB
MA
Mamba 130m Hf
Mamba · mradermacher
Params129M
Context1024K
Q4_K_M0.1 GB
GE
Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma-2b-it
Gemma · codegood
Params2.51B
Context8K
Q4_K_M1.6 GB
OP
OpenClaude 1.7B Merged
Openclaude · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
IN
InRanker Base
Inranker · mradermacher
Params248M
Context512
Q4_K_M0.2 GB
LL
Llama SmolTalk 3.2 1B Instruct
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
WH
When2Think ThinkOnly 1.5B
When · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
IN
Internvl3-2B
Internvl · unsloth
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
ThinkingCap Qwen3.6 27B MTP
Qwen · protoLabsAI
Params461M
Context256K
Q4_K_M15.7 GB
PA
parakeet ctc 1.1b ja
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
TE
Bonsai 2 27B PTQ1 0 MTP Uncensored Ready
Ternary · ayshinko
Params2M
Context—
Smallest0.0 GB
PI
PixieZehirNano
Pixiezehirnano · mradermacher
Params1.83B
Context16K
Q4_K_M1.1 GB
QW
Qwen2.5 Sex
Qwen · ystemsrx
Params1.54B
Context—
Smallest3.1 GB
SA
sam 3d body dinov3
Sam · LocalAI-io
Params841M
Context—
Smallest0.2 GB
LF
LFM3 1.7B Base heretic
Lfm · saidutta69
Params1.73B
Context256K
Q4_K_M1.1 GB
MI
miniclaus qw1.5B UNAMGS
Miniclaus · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
Llama 3.2 3B ORPO Advertisement
Llama · yothinS
Params3.2B
Context128K
Smallest1.4 GB
HU
HunyuanOCR
Hunyuanocr · mradermacher
Params539M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 3B Instruct
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GR
granite speech 4.1 2b nar
Granite · cstr
Params2.25B
Context—
Smallest1.6 GB
TI
TinySlime-1.1B-v1.0
Tinyslime · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Ternary-Bonsai-2-9B-DFlash2
Qwen · suryatmodulus
Params1.47B
Context256K
Smallest1.6 GB
GE
Gemma 2 2b baymax i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
QwenGram-0.8B REAL-15M R=1
Qwen · Ninnix96
Params783M
Context256K
Q4_K_M0.6 GB
FO
fortunetelling
Fortunetelling · picturelove
Params1.78B
Context128K
Smallest1.9 GB
LF
LFM2.5 350M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB