Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
FA
Falcon H1 0.5B Instruct
Falcon · tiiuae
Params521M
Context16K
Q4_K_M0.3 GB
GGUF
MI
MiniCPM5 2B Abliterated Uncensored Safetensors
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
Tool use
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
LF
LFM2.5 2.6B heretic uncensored
Lfm · noctrex
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
QW
Qwen3.5 2B Artemis
Qwen · turintech
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen2.5 0.5b RBase
Qwen · QuantFactory
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen3.8 max Reasoning Distilled
Qwen · khazarai
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningVision
MI
MiniCPM5 1B Heretic
MiniCPM · saidutta69
Params1.08B
Context128K
Q4_K_M0.7 GB
ReasoningTool use
SP
rizzo flow 1.7b
Spark · rizzoaiacademy
Params1.71B
Context1024K
Q4_K_M1.1 GB
Coding
QW
Qwen3.8 2B Heretic
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
PA
parakeet rnnt 1.1b
Parakeet · cstr
Params1.07B
Context—
Smallest0.7 GB
GGUF
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
Embedding
OM
omniASR CTC 1B v2
Omniasr · cstr
Params976M
Context—
Smallest0.6 GB
GGUF
IN
Internlm2_5 1_8b Chat
InternLM · bartowski
Params1.89B
Context32K
Q4_K_M1.2 GB
GGUF
DU
DualMind TKD Agentic 1.7B
Dualmind · reaperdoesntknow
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
LL
Dolphin 3.0 Llama 3.2 3B
Llama · itlwas
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
LL
Llama2.C stories15M
Llama · mradermacher
Params24M
Context256
Q4_K_M0.0 GB
GGUF
SM
Biggie SmoLlm 0.4B
SmolLM · QuantFactory
Params401M
Context2K
Q4_K_M0.3 GB
GGUF
LF
LFM2 350M Math
Lfm · LiquidAI
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
LL
Llama 3.2 1B Instruct heretic
Llama · saidutta69
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
TE
Tessa T1 3B
Tessa · bartowski
Params3.09B
Context117K
Q4_K_M1.9 GB
GGUF
GR
Granite 4.0 H Micro
Granite · bartowski
Params3.2B
Context1024K
Q4_K_M1.9 GB
GGUF
PA
fluid-speech-mini
Parakeet · FluidVoice-Labs
Params627M
Context—
Smallest0.3 GB
GGUF
FL
Flan T5 Large Grammar Synthesis
Flan · pszemraj
Params780M
Context512
Smallest0.6 GB
GGUF
MO
moonshine-streaming-tiny
Moonshine · cstr
Params44M
Context—
Smallest0.0 GB
GGUF
QW
Selora AI LLM 1.7B
Qwen · selorahomes
Params2.03B
Context40K
Smallest0.0 GB
GGUF
SM
Smart Commit 0.5b v0.3
Smart · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · QuantFactory
Params2.6B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 4 31B it qat MTP
Gemma · magnitudedev
Params470M
Context128K
Smallest0.3 GB
ReasoningTool use

Other sizes

Keep browsing