Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
YI
CursorCore Yi 1.5B i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
Coding
OR
orpheus 3b 0.1 ft
Orpheus · cstr
Params3.3B
Context—
Smallest0.0 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
LL
8 Goldfish Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
MI
MiniMax M3.1 Flash Q2 K
Minimax · smalinin
Params2.12B
Context1024K
Smallest3.9 GB
ReasoningTool useVision
QW
Qwen3.5-0.8B-Fable-GPT6
Qwen · Shreesha-2011
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
DE
Nemotron Research Reasoning Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
CH
Chinese Decision 0.8b
Chinese · quincyqiang
Params752M
Context256K
Smallest0.8 GB
ReasoningTool use
MA
macadeliccc magistrate 3.2 3b it
Macadeliccc · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Qwopus3.5 2B v3
Qwopus · Jackrong
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
GR
Granite 4.0 350m Base
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
MI
LeChatonFat Final
Mistral · squ11z1
Params3.43B
Context256K
Q4_K_M2.1 GB
Tool use
MI
mimo tokenizer
Mimo · cstr
Params649M
Context—
Smallest0.4 GB
GGUF
TI
TinyLlama 1.1B Chat v0.5
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
GU
GUI Actor Verifier 2B
Gui · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · second-state
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
SN
snac 24khz
Snac · cstr
Params13M
Context—
Smallest0.0 GB
GGUF
LL
Llama 3.2 3B It Chinese Kyara
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
AT
Atomight V2.5 1.7B C1
Atomight · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
GR
granite vision 3.3 2b
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
Tool useVision
GE
Gemma 2 2B Stheno Filtered
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GL
GLM 5.3 Flash UNCENSORED
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B NVFP4 MTP
Ornith · tiyuvta
Params67M
Context—
Smallest0.0 GB
GGUF
HO
Home 3B v3
Home · acon96
Params2.8B
Context4K
Q4_K_M1.7 GB
Coding
FI
fishstop AI lite
Fishstop · fishstop
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningTool use
QW
Qwen3 TTS 12Hz 0.6B CustomVoice
Qwen · BricksDisplay
Params652M
Context32K
Q4_K_M0.4 GB
GGUF
QW
Qwen2.5 3B Instruct lora sex float16
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
AN
Anima2
Anima · JusteLeo
Params2.09B
Context—
Q4_K_M1.2 GB
GGUF
BI
bitnet embedding 0.6b
Bitnet · microsoft
Params596M
Context32K
Smallest0.4 GB
Embedding
LL
Llama 3.2 Korean Bllossom 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use

Other sizes

Keep browsing