Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
ST
stable-code-instruct-3b
Stable · stabilityai
Params2.8B
Context16K
Q4_K_M1.7 GB
WA
wan 1.3b
Wan · bykhan
Params127M
Context—
Q4_K_M1.0 GB
OL
OLMo 1B 0724 Hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GE
anon 1b
Gemma · scratchyone
Params1B
Context32K
Smallest2.0 GB
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
ST
stable diffusion 3.5 medium turbo
Stable · tensorart
Params2.47B
Context—
Q4_K_M1.8 GB
LF
LFM2 2.6B Transcript
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
FL
FLOR 1.3B Instructed
Flor · xaviviro
Params1.41B
Context4K
Q4_K_M0.9 GB
HO
K2 Horizon 0.9B
Horizon · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
GA
GameScaling 2B S3
Gamescaling · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
OR
Ornith 1.5 35B A3B BigBang MTP
Ornith · EryriLabs
Params1.86B
Context256K
Q4_K_M21.2 GB
NA
Nano.Imp Creative.Writing Heretic 3.2 1B
Nano · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
MI
Minimax Music3
Minimax · molbal
Params2.46B
Context—
Smallest1.5 GB
RE
realvisxl v5.0 lightning
Realvisxl · off-grid-ai
Params3.47B
Context—
Smallest2.8 GB
DA
danube2-1.8b-CodeFeedback
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
QW
Qwen2.5 Coder 1.5B
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
LF
LFM2.5 2.6B Tema_Q Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
AA
aac pictogram retriever ptbr
Aac · Papuguinho
Params155M
Context2K
Q4_K_M0.1 GB
GR
granite 3.1 2b instruct
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
DE
deepseek-coder-1.3b-instruct
DeepSeek · duyntnet
Params1.35B
Context16K
Q4_K_M0.9 GB
MI
MiniCPM
MiniCPM · runfuture
Params2.72B
Context2K
Smallest1.7 GB
TI
TinySolar-248m-4k-py
Tinysolar · RichardErkhov
Params248M
Context32K
Q4_K_M0.2 GB
FI
FireRedASR2-AED
Fireredasr · cstr
Params1.18B
Context—
Smallest1.0 GB
MA
Mamba2 130m Hf
Mamba · rpatel622
Params168M
Context1024K
Smallest0.2 GB
QW
Qwen3-TTS-12Hz-0.6B-CustomVoice
Qwen · sakasegawa
Params1.02B
Context—
Smallest0.8 GB
KI
Kimodo-G1-SEED-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
QW
qwen3 asr 1.7b ja anime
Qwen · cstr
Params2.35B
Context—
Smallest1.5 GB
GE
Gemma 2 2b It
Gemma · BafS
Params2.61B
Context8K
Q4_K_M1.7 GB