Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
GE
Models Google Gemma 3 1b It
Gemma · MaziyarPanahi
Params1B
Context32K
Q4_K_M0.8 GB
MU
MuScriptor Small
Muscriptor · DamRsn
Params1.37B
Context—
Smallest0.2 GB
GR
Granite Speech 4.1 2B
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
FU
Fun ASR MLT Nano 2512
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
QW
Qwen3 TTS 12Hz 1.7B Base
Qwen · ggml-org
Params1.73B
Context32K
Q4_K_M1.0 GB
WH
Whisper Large
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
LL
Llama 3.2 1B Instruct
Llama · hugging-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
OP
Tinyopenjev For Testing
Openjev · ggml-org
Params33M
Context256K
Smallest0.0 GB
AU
Audio8-TTS-Preview-0.6b
Audio · js-byte
Params1.3B
Context—
Smallest1.4 GB
QW
Qwen3 ASR 1.7B
Qwen · ggml-org
Params2.03B
Context64K
Smallest2.2 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
SE
SenseVoiceSmall GGUF audiocpp
Sensevoicesmall · FunAudioLLM
Params234M
Context—
Smallest0.3 GB
SM
SmolVLM2 2.2B Instruct
Smolvlm · ggml-org
Params1.81B
Context8K
Q4_K_M1.1 GB
LF
LFM3 Omni 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
VI
VieNeu-TTS-v3-Turbo
Vieneu · phuocnguyen90
Params146M
Context—
Smallest0.2 GB
SM
SmolLM3 3B
SmolLM · bartowski
Params3.08B
Context64K
Q4_K_M1.9 GB
TI
TIPO 500M
Tipo · KBlueLeaf
Params508M
Context2K
Smallest1.0 GB
LF
Lfm2.5-1.2B-Instruct
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated
Qwen · huihui-ai
Params7M
Context—
Smallest0.0 GB
QW
LFM2.5 2.6B
Qwen · DavidAU
Params2.7B
Context128K
Smallest1.5 GB
SE
Sentence Bert Swedish Cased
Sentence · KBLab
Params124M
Context512
Smallest0.3 GB
SM
SmolVLM 500M Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
LL
Llama 3.2 3B Instruct
Llama · hugging-quants
Params3.21B
Context128K
Q4_K_M2.0 GB
WH
Whisper Large v2
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
LF
LFM3 VL 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
PA
orukeet-gabor-half.q8_0
Parakeet · oruk
Params627M
Context—
Smallest0.7 GB
CA
Canary 1B Flash
Canary · handy-computer
Params890M
Context—
Q4_K_M0.7 GB
QW
Qwen3.6 35B A3B DFlash
Qwen · jcuypers
Params474M
Context256K
Q4_K_M0.3 GB
MA
madlad400 3b mt
Madlad · google
Params2.94B
Context—
Smallest1.0 GB
US
RE USE
Use · audio-cpp
Params10M
Context—
Smallest0.0 GB