Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
ER
ERNIE 4.5 0.3B PT
Ernie · bartowski
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
LF
LFM3 1.7B
Lfm · ngquocvinh
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
GP
Gpt2 Xl
Gpt · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
QW
Qwen3.5 27B Uncensored Heretic v2 Native MTP Preserved
Qwen · llmfan46
Params461M
Context256K
Q4_K_M17.2 GB
Vision
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
PY
pythia 160m
Pythia · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
GR
Granite 4.0 Micro
Granite · bartowski
Params3.4B
Context128K
Q4_K_M2.1 GB
GGUF
VE
VertaLily 1.2 1B
Vertalily · VLTX
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
OM
omni json
Omni · erukude
Params45M
Context—
Smallest0.1 GB
GGUF
QW
imajev 2b
Qwen · mindchain
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
LF
Lfm2-1.2B
Lfm · unsloth
Params1.17B
Context32K
Q4_K_M0.7 GB
GGUF
OR
Ornith 1.5 9B DFlash
Ornith · abenzerps
Params1.29B
Context256K
Q4_K_M0.8 GB
Reasoning
MI
MiniChat 1.5 3B Sorah
Minichat · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
MO
Moonshine Tiny
Moonshine · handy-computer
Params27M
Context—
Smallest0.0 GB
GGUF
BE
BeeLLM 30P
Beellm · schizophyllume
Params12M
Context4K
Smallest0.0 GB
GGUF
LF
LFM3 1.7B
Lfm · bartowski
Params1.73B
Context256K
Q4_K_M1.1 GB
CodingReasoningTool use
CO
codegemma-1.1-2b
Codegemma · mmnga
Params2.51B
Context8K
Q4_K_M1.6 GB
Coding
NE
NeuTTS Nano
Neutts · BricksDisplay
Params262M
Context2K
Q4_K_M0.2 GB
GGUF
MI
MiniCPM5 2B heretic
MiniCPM · saidutta69
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
ST
StartLux-Decision-v1.1-2B-Instant
Startlux · startlux-models
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
GE
lei HuggingFace Gemma 2 9B 4bit Chat Level Measurement Guide 07242024
Gemma · RichardErkhov
Params3.4B
Context—
Q4_K_M1.7 GB
GGUF
ER
Ernie-4.5-0.3B-Pt
Ernie · unsloth
Params361M
Context128K
Q4_K_M0.2 GB
GGUF
QW
Katy 27B
Qwen · sirfyyn
Params1.92B
Context256K
Smallest0.0 GB
GGUF
TU
sd turbo
Turbo · samoudi
Params1.3B
Context—
Smallest1.8 GB
GGUF
LL
NousResearch DeepHermes 3 Llama 3 3B Preview
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
ReasoningRoleplayTool use
QW
Qwen3 0.6B
Qwen · QuantFactory
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
QW
Qwen1.5-1.8B-Chat-AWQ-fp16
Qwen · Qwen
Params1.84B
Context32K
Q4_K_M1.2 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · QuantFactory
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
AK
Akins 3B
Akins · TheBloke
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
QW
sakura-1.5b-qwen2.5-v1.0-fp16
Qwen · SakuraLLM
Params1.78B
Context128K
Smallest3.6 GB
GGUF

Other sizes

Keep browsing