Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Models Google Gemma 3 1b It
Gemma · MaziyarPanahi
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
MU
MuScriptor Small
Muscriptor · DamRsn
Params1.37B
Context—
Smallest0.2 GB
GGUF
GR
Granite Speech 4.1 2B
Granite · handy-computer
Params2.31B
Context—
Q4_K_M1.6 GB
GGUF
FU
Fun ASR MLT Nano 2512
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
GGUF
QW
Qwen3 TTS 12Hz 1.7B Base
Qwen · ggml-org
Params1.73B
Context32K
Q4_K_M1.0 GB
Vision
WH
Whisper Large
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · hugging-quants
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
OP
Tinyopenjev For Testing
Openjev · ggml-org
Params33M
Context256K
Smallest0.0 GB
Vision
AU
Audio8-TTS-Preview-0.6b
Audio · js-byte
Params1.3B
Context—
Smallest1.4 GB
GGUF
QW
Qwen3 ASR 1.7B
Qwen · ggml-org
Params2.03B
Context64K
Smallest2.2 GB
Vision
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · bartowski
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
SE
SenseVoiceSmall GGUF audiocpp
Sensevoicesmall · FunAudioLLM
Params234M
Context—
Smallest0.3 GB
GGUF
SM
SmolVLM2 2.2B Instruct
Smolvlm · ggml-org
Params1.81B
Context8K
Q4_K_M1.1 GB
Vision
LF
LFM3 Omni 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
VI
VieNeu-TTS-v3-Turbo
Vieneu · phuocnguyen90
Params146M
Context—
Smallest0.2 GB
GGUF
SM
SmolLM3 3B
SmolLM · bartowski
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
TI
TIPO 500M
Tipo · KBlueLeaf
Params508M
Context2K
Smallest1.0 GB
Vision
LF
Lfm2.5-1.2B-Instruct
Lfm · unsloth
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Huihui Qwen3.8 27B Coder390 EfficientThink abliterated
Qwen · huihui-ai
Params7M
Context—
Smallest0.0 GB
GGUF
QW
LFM2.5 2.6B
Qwen · DavidAU
Params2.7B
Context128K
Smallest1.5 GB
Reasoning
SE
Sentence Bert Swedish Cased
Sentence · KBLab
Params124M
Context512
Smallest0.3 GB
Embedding
SM
SmolVLM 500M Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
Vision
LL
Llama 3.2 3B Instruct
Llama · hugging-quants
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
WH
Whisper Large v2
Whisper · handy-computer
Params1.54B
Context—
Q4_K_M1.0 GB
GGUF
LF
LFM3 VL 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
PA
orukeet-gabor-half.q8_0
Parakeet · oruk
Params627M
Context—
Smallest0.7 GB
GGUF
CA
Canary 1B Flash
Canary · handy-computer
Params890M
Context—
Q4_K_M0.7 GB
GGUF
QW
Qwen3.6 35B A3B DFlash
Qwen · jcuypers
Params474M
Context256K
Q4_K_M0.3 GB
GGUF
MA
madlad400 3b mt
Madlad · google
Params2.94B
Context—
Smallest1.0 GB
GGUF
US
RE USE
Use · audio-cpp
Params10M
Context—
Smallest0.0 GB
GGUF

Other sizes

Keep browsing