Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
LL
Hermes 3 Llama 3.2 3b Base Fft Chatml Rerun 8xh100 E4 2024 11 24 4k Steps
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
QW
Qwen3.5-2B
Qwen · unsloth
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen_Qwen3.5 0.8B
Qwen · lmstudio-community
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen2.5 VL 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3.6 35B A3B Uncensored HauhauCS MTP
Qwen · morikomorizz
Params447M
Context256K
Smallest15.9 GB
Vision
BR
breeze-tts-2
Breeze · cstr
Params2.85B
Context—
Smallest2.2 GB
GGUF
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · huihui-ai
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3 0.6B Heretic Heresy Edition
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
LF
LFM3 1.7B
Lfm · LiquidAI
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
MI
MiniCPM V 4_6
MiniCPM · openbmb
Params752M
Context256K
Q4_K_M0.5 GB
Vision
LF
LFM2.5 2.6B UNCENSORED ABLITERATED PHILADELPHIA CLASS
Lfm · PhillyLabs
Params2.7B
Context125K
Smallest5.4 GB
Reasoning
QW
Qwen3.5-0.8B
Qwen · weareapexcreators
Params773M
Context256K
Q4_K_M0.5 GB
Vision
GR
Granite 4.0 350M BE
Granite · taronaeo
Params352M
Context—
Q4_K_M0.2 GB
GGUF
QW
Qwen2 VL 2B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Vision
LF
LFM2.5-350M
Lfm · weareapexcreators
Params354M
Context125K
Smallest0.4 GB
GGUF
GR
Granite 4.0 H 350M BE
Granite · taronaeo
Params340M
Context—
Q4_K_M0.2 GB
GGUF
GI
GigaAM v3 RNN-T
Gigaam · handy-computer
Params222M
Context—
Q4_K_M0.2 GB
GGUF
MI
Ming 3.0 TTS 0.5B
Ming · audio-cpp
Params1.6B
Context—
Smallest1.7 GB
GGUF
LF
LFM2 VL 1.6B
Lfm · LiquidAI
Params1.17B
Context125K
Smallest0.7 GB
Vision
PA
PaddleOCR VL 1.5
Paddleocr · PaddlePaddle
Params467M
Context128K
Smallest0.9 GB
Vision
GE
gemma-2b-it
Gemma · lmstudio-ai
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
LF
LFM2.5 230M LocalAI
Lfm · weareapexcreators
Params230M
Context125K
Smallest0.2 GB
GGUF
JI
jina reranker v1 tiny en
Jina · mradermacher
Params33M
Context8K
Q4_K_M0.0 GB
CodingEmbedding
LA
LatentSync 1.6
Latentsync · audio-cpp
Params1.37B
Context—
Smallest2.1 GB
GGUF
QW
Qwen3.5-2B
Qwen · weareapexcreators
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
LL
Llama 3.2 3B Instruct abliterated
Llama · QuantFactory
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Qwen3.5 2B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningVision
MI
MiniCPM5 2B LocalAI
MiniCPM · weareapexcreators
Params2.52B
Context128K
Smallest2.7 GB
GGUF
QW
Qwen3 ASR 0.6B
Qwen · ggml-org
Params752M
Context64K
Smallest0.8 GB
Vision
LF
LFM2.5 1.2B Instruct LocalAI
Lfm · weareapexcreators
Params1.17B
Context125K
Smallest1.2 GB
GGUF

Other sizes

Keep browsing