Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
M2
m2m100 418m
cstr
Params486M
Context—
Smallest0.3 GB
WA
wai-illustrious-sdxl.fp16.gguf
Wai · void-gryph
Params2.57B
Context77
Q4_K_M1.4 GB
QW
Qwen3 0.6B
Qwen · duyntnet
Params752M
Context40K
Q4_K_M0.5 GB
QW
Qwen2.5 3b Chess v7
Qwen · Ryu-tek
Params3.09B
Context32K
Q4_K_M1.9 GB
QW
Qwen2.5 1.5B Instruct
Qwen · second-state
Params1.54B
Context32K
Q4_K_M1.0 GB
LL
TeenyTinyLlama-Doc-160m
Llama · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
MI
MinerU2.5-2509-1.2B
Mineru · Mungert
Params494M
Context16K
Q4_K_M0.4 GB
AR
AGI 0 Art Skynet 3B
Art · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
DE
DeepScaleR 1.5B Preview Abliterated
Deepscaler · ThomasBaruzier
Params1.78B
Context128K
Q4_K_M1.1 GB
FI
fireredtts3
Fireredtts · cstr
Params2.12B
Context—
Smallest1.1 GB
QW
Replete LLM V2.5 Qwen 1.5b
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
QW
Qwen Uncensored
Qwen · Xennon-BD
Params494M
Context128K
Q4_K_M0.4 GB
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
LF
LFM3 1.7B abliterated
Lfm · bowtiedrahman
Params1.73B
Context256K
Q4_K_M1.1 GB
QW
Models Qwen Qwen2.5 0.5B Instruct
Qwen · MaziyarPanahi
Params494M
Context32K
Q4_K_M0.4 GB
GE
EZO Common T2 2B Gemma 2 It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
DE
deepseek-ocr2
DeepSeek · cstr
Params3.39B
Context—
Smallest2.3 GB
LL
Llama3.2 3B Enigma
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB
LF
LFM2.5 Encoder 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
QW
ari assistant 1.5b
Qwen · sriyuth
Params1.54B
Context32K
Smallest1.0 GB
PA
parakeet ultra
Parakeet · cstr
Params627M
Context—
Smallest0.4 GB
AU
authormist originality
Authormist · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
MiniCPM V 4.7 1B DSpark
MiniCPM · magnitudedev
Params214M
Context256K
Smallest0.2 GB
LF
LFM2.5 1.2B Instruct heretic
Lfm · richardyoung
Params1.17B
Context125K
Q4_K_M0.7 GB
SM
SmolLM2 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
QW
Qwen3.8 Uncensored NVFP4 MTP
Qwen · BennyDaBall
Params461M
Context256K
Smallest19.7 GB
LL
Llama Sentient 3.2 3B Instruct i1
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
FA
Falcon H1 1.5B Deep Instruct
Falcon · tiiuae
Params1.55B
Context128K
Q4_K_M0.9 GB
PA
PaddleOCR VL 1.6
Paddleocr · mradermacher
Params467M
Context128K
Q4_K_M0.3 GB
LL
Llama 3.2 3B Instruct
Llama · QuantFactory
Params3.21B
Context128K
Q4_K_M2.0 GB