Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
RA
RakutenAI 2.0 Mini Instruct
Rakutenai · mmnga
Params1.53B
Context128K
Q4_K_M0.9 GB
ST
starcoder2-3b
StarCoder · second-state
Params3.03B
Context16K
Q4_K_M1.8 GB
OP
OpenELM 1_1B Instruct
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GR
granite-4.0-micro-base
Granite · Mungert
Params3.4B
Context128K
Q4_K_M2.1 GB
QW
Qwen2.5 Coder 3B Instruct heretic
Qwen · saidutta69
Params3.1B
Context32K
Q4_K_M1.9 GB
NO
Nomic Embed Text V2
Nomic · ggml-org
Params475M
Context2K
Smallest0.5 GB
LF
Lfm2.5-Vl-1.6B
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
MU
multiagent orchestrator
Multiagent · erukude
Params45M
Context—
Smallest0.1 GB
SN
Snowflake Arctic Embed L v2.0
Snowflake · Casual-Autopsy
Params567M
Context8K
Q4_K_M0.4 GB
TR
TRELLIS image large
Trellis · LocalAI-io
Params74M
Context—
Smallest0.1 GB
MI
YuisekinAI Mistral 0.7B
Mistral · RichardErkhov
Params746M
Context4K
Q4_K_M0.5 GB
VI
vibevoice asr bitnet
Vibevoice · cstr
Params2.24B
Context—
Smallest0.0 GB
CO
Yi Coder 1.5B
Coder · QuantFactory
Params1.48B
Context128K
Q4_K_M1.0 GB
QW
Qwen3 0.6B Distilled 30B A3B Thinking SFT
Qwen · reaperdoesntknow
Params752M
Context40K
Q4_K_M0.5 GB
LA
laya_english_unsloth_dynamic
Laya · mys
Params422M
Context—
Q4_K_M0.4 GB
TA
UI TARS 2B SFT
Tars · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
DO
Dots.Mocr
Dots · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
GR
Granite 3b Code Base 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
GE
gemma 4 E2B it qat MTP
Gemma · magnitudedev
Params77M
Context128K
Smallest0.1 GB
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
QW
Qwen2.5 0.5B Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
QW
qwen rp 0.5b
Qwen · andybanana
Params494M
Context32K
Q4_K_M0.4 GB
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · second-state
Params1.1B
Context2K
Q4_K_M0.7 GB
GE
Gemini Nano Gemmafied
Gemma · mradermacher
Params3.24B
Context8K
Q4_K_M2.1 GB
SM
SmolLM2-135M
SmolLM · ggml-org
Params135M
Context8K
Q4_K_M0.1 GB
QW
Qwen3.5 2B
Qwen · gguf
Params1.94B
Context256K
Q4_K_M1.3 GB
VE
Q25 1.5B VeoLu
Veolu · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen3 ASR 1.7B
Qwen · mradermacher
Params2.03B
Context64K
Q4_K_M1.3 GB
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB