Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
PA
Parakeet RNN-T 0.6B
Parakeet · handy-computer
Params617M
Context—
Q4_K_M0.5 GB
CO
Cohere Transcribe
Cohere · handy-computer
Params2.05B
Context—
Q4_K_M1.6 GB
TI
TIPO v2.1 1B A200M
Tipo · KBlueLeaf
Params1.01B
Context4K
Smallest1.1 GB
SM
SmolLM2 135M
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
MI
MiniCPM5 2B
MiniCPM · bartowski
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · bartowski
Params1.78B
Context32K
Q4_K_M1.1 GB
GL
GLM 5.3 Flash UNCENSORED mlx oQ8e DFlash2
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest2.4 GB
MA
ms marco MiniLM L6 v2 Q8 0
Marco · sinjab
Params23M
Context512
Smallest0.0 GB
GR
Granite 4.1 3b
Granite · ibm-granite
Params3.4B
Context128K
Q4_K_M2.1 GB
WH
Whisper Small (English)
Whisper · handy-computer
Params242M
Context—
Q4_K_M0.2 GB
GE
Assistant
Gemma · RachidAR
Params420M
Context128K
Smallest0.2 GB
PA
Parakeet CTC 1.1B
Parakeet · handy-computer
Params1.06B
Context—
Q4_K_M0.8 GB
QW
Qwen2.5 1.5B Instruct uncensored
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
D1
d1 2B
LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
MI
MiniCPM V 4.7 1B LocalAI
MiniCPM · weareapexcreators
Params1.01B
Context256K
Smallest1.1 GB
NA
vllm-d3-nano
Nano · ggml-org
Params2.4B
Context256K
Smallest2.6 GB
HA
Harrier Oss v1 0.6b
Harrier · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
QW
Qwen3-Vl-2B-Thinking
Qwen · unsloth
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen3.5 4B heretic imatrix
Qwen · FadedRedStar
Params334M
Context256K
Q4_K_M2.7 GB
QW
Qwen2.5 VL 3B Instruct
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
XX
encoder
Xxl · chatpig
Params219M
Context512
Q4_K_M2.9 GB
OR
Ornith 1.5 9b Mtp
Ornith · protoLabsAI
Params456M
Context256K
Q4_K_M5.8 GB
LF
LiquidAI_LFM2.5 1.2B Instruct
Lfm · lmstudio-community
Params1.17B
Context125K
Q4_K_M0.7 GB
CE
mispeech/ced-tiny
Ced · mudler
Params86M
Context—
Smallest0.0 GB
FU
Fun ASR Nano
Fun · FunAudioLLM
Params234M
Context—
Smallest0.5 GB
MI
MiniCPM5 2B Math
MiniCPM · Caldalis
Params2.52B
Context128K
Q4_K_M1.6 GB
QW
Qwen3.6 35B Uncensored HauhauCS 1M
Qwen · satgeze
Params447M
Context1024K
Q4_K_M21.7 GB
MI
MiniCPM V 4.7 1B heretic
MiniCPM · saidutta69
Params1.01B
Context256K
Q4_K_M0.7 GB
DA
DanTagGen beta
Dantaggen · KBlueLeaf
Params393M
Context512
Smallest0.3 GB
OR
Ornith 1.5 35B A3B
Ornith · SC117
Params447M
Context256K
Smallest14.4 GB