Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
RA
RakutenAI 2.0 Mini Instruct
Rakutenai · mmnga
Params1.53B
Context128K
Q4_K_M0.9 GB
GGUF
ST
starcoder2-3b
StarCoder · second-state
Params3.03B
Context16K
Q4_K_M1.8 GB
Coding
OP
OpenELM 1_1B Instruct
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
GR
granite-4.0-micro-base
Granite · Mungert
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct heretic
Qwen · saidutta69
Params3.1B
Context32K
Q4_K_M1.9 GB
CodingRoleplay
NO
Nomic Embed Text V2
Nomic · ggml-org
Params475M
Context2K
Smallest0.5 GB
Embedding
LF
Lfm2.5-Vl-1.6B
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
Vision
MU
multiagent orchestrator
Multiagent · erukude
Params45M
Context—
Smallest0.1 GB
GGUF
SN
Snowflake Arctic Embed L v2.0
Snowflake · Casual-Autopsy
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
TR
TRELLIS image large
Trellis · LocalAI-io
Params74M
Context—
Smallest0.1 GB
GGUF
MI
YuisekinAI Mistral 0.7B
Mistral · RichardErkhov
Params746M
Context4K
Q4_K_M0.5 GB
GGUF
VI
vibevoice asr bitnet
Vibevoice · cstr
Params2.24B
Context—
Smallest0.0 GB
GGUF
CO
Yi Coder 1.5B
Coder · QuantFactory
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
QW
Qwen3 0.6B Distilled 30B A3B Thinking SFT
Qwen · reaperdoesntknow
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
LA
laya_english_unsloth_dynamic
Laya · mys
Params422M
Context—
Q4_K_M0.4 GB
GGUF
TA
UI TARS 2B SFT
Tars · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
Vision
DO
Dots.Mocr
Dots · prithivMLmods
Params1.78B
Context128K
Q4_K_M1.1 GB
CodingVision
GR
Granite 3b Code Base 128k
Granite · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
GE
gemma 4 E2B it qat MTP
Gemma · magnitudedev
Params77M
Context128K
Smallest0.1 GB
GGUF
GP
Gpt2 Large
Gpt · mradermacher
Params838M
Context1K
Q4_K_M0.5 GB
GGUF
QW
Qwen2.5 0.5B Instruct
Qwen · legraphista
Params494M
Context32K
Smallest0.3 GB
GGUF
QW
qwen rp 0.5b
Qwen · andybanana
Params494M
Context32K
Q4_K_M0.4 GB
Roleplay
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · second-state
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
GE
Gemini Nano Gemmafied
Gemma · mradermacher
Params3.24B
Context8K
Q4_K_M2.1 GB
GGUF
SM
SmolLM2-135M
SmolLM · ggml-org
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
QW
Qwen3.5 2B
Qwen · gguf
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
VE
Q25 1.5B VeoLu
Veolu · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GGUF
TI
abdgrt_tinyllama-2-1b-miniguanaco
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen3 ASR 1.7B
Qwen · mradermacher
Params2.03B
Context64K
Q4_K_M1.3 GB
Vision
LF
Lfm2-350M
Lfm · unsloth
Params354M
Context32K
Q4_K_M0.2 GB
GGUF

Other sizes

Keep browsing