Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
BG
bge m3 Q8 0
BGE · ggml-org
Params567M
Context8K
Smallest0.6 GB
Embedding
NE
Nemotron Speech Streaming EN
Nemotron · handy-computer
Params618M
Context—
Q4_K_M0.5 GB
GGUF
LF
LFM3 Audio 2B
Lfm · LiquidAI
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
ST
stable diffusion 3.5 medium
Stable · second-state
Params695M
Context—
Smallest0.1 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
IN
Index Translate 2B
Index · IndexTeam
Params1.94B
Context256K
Q4_K_M1.3 GB
Vision
MI
MiniCPM V 4.7 35B A3B DSpark
MiniCPM · openbmb
Params389M
Context256K
Q4_K_M0.2 GB
Tool useVision
NE
NVIDIA Nemotron 3.5 Bolt 74B A9B 24GB LiLiCorr
Nemotron · nvidia
Params1.11B
Context256K
Smallest1.0 GB
GGUF
QW
DFlash
Qwen · Alittlehammmer
Params1.73B
Context256K
Q4_K_M1.0 GB
GGUF
PA
Parakeet CTC 0.6B
Parakeet · handy-computer
Params609M
Context—
Q4_K_M0.5 GB
GGUF
QW
Qwopus3.5 9B Coder MTP
Qwopus · Jackrong
Params456M
Context256K
Q4_K_M5.8 GB
CodingReasoningTool use
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Andycurrent
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 0.6B Heretic Heresy Edition
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · bartowski
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
TI
Tinylaya For Testing
Tinylaya · ggml-org
Params90M
Context8K
Smallest0.1 GB
GGUF
SM
SmolVLM2 500M Video Instruct
Smolvlm · ggml-org
Params409M
Context8K
Smallest0.4 GB
Vision
SM
SmolVLM 256M Instruct
Smolvlm · ggml-org
Params163M
Context8K
Smallest0.2 GB
Vision
LF
Lfm2.5-Vl-3B
Lfm · unsloth
Params2.7B
Context125K
Q4_K_M1.7 GB
Vision
FU
Fun-ASR Nano
Fun · handy-computer
Params830M
Context—
Q4_K_M0.6 GB
GGUF
MI
Ministral 3 3B Instruct 2512
Mistral · bartowski
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
IM
z image
Image · gguf-org
Params84M
Context—
Q4_K_M4.5 GB
GGUF
QW
qwen3-tts-tokenizer-12hz
Qwen · cstr
Params162M
Context—
Smallest0.3 GB
GGUF
QW
Qwen3.8 27B ZeroRefusal UD IQ4 XS MTP
Qwen · QQZ2026
Params461M
Context—
Smallest0.0 GB
GGUF
QW
Qwen3 0.6B Abliterated
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 0.6B Heretic
Qwen · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
VI
VieNeu TTS v2
Vieneu · pnnbao-ump
Params294M
Context4K
Smallest0.2 GB
Coding
SM
SmolLM2 360M Instruct
SmolLM · HuggingFaceTB
Params362M
Context8K
Smallest0.4 GB
GGUF
TU
SD Turbo
Turbo · Green-Sky
Params1.3B
Context—
Smallest2.0 GB
GGUF

Other sizes

Keep browsing