Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
YI
CursorCore Yi 1.5B i1
Yi · mradermacher
Params1.48B
Context128K
Q4_K_M1.0 GB
OR
orpheus 3b 0.1 ft
Orpheus · cstr
Params3.3B
Context—
Smallest0.0 GB
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
LL
8 Goldfish Loss Llama 1B
Llama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
MI
MiniMax M3.1 Flash Q2 K
Minimax · smalinin
Params2.12B
Context1024K
Smallest3.9 GB
QW
Qwen3.5-0.8B-Fable-GPT6
Qwen · Shreesha-2011
Params752M
Context256K
Q4_K_M0.5 GB
DE
Nemotron Research Reasoning Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
CH
Chinese Decision 0.8b
Chinese · quincyqiang
Params752M
Context256K
Smallest0.8 GB
MA
macadeliccc magistrate 3.2 3b it
Macadeliccc · RichardErkhov
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwopus3.5 2B v3
Qwopus · Jackrong
Params1.88B
Context256K
Q4_K_M1.3 GB
GR
Granite 4.0 350m Base
Granite · ibm-granite
Params352M
Context32K
Q4_K_M0.2 GB
MI
LeChatonFat Final
Mistral · squ11z1
Params3.43B
Context256K
Q4_K_M2.1 GB
MI
mimo tokenizer
Mimo · cstr
Params649M
Context—
Smallest0.4 GB
TI
TinyLlama 1.1B Chat v0.5
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GU
GUI Actor Verifier 2B
Gui · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
ST
stablelm-2-zephyr-1_6b
Stablelm · second-state
Params1.64B
Context4K
Q4_K_M1.0 GB
SN
snac 24khz
Snac · cstr
Params13M
Context—
Smallest0.0 GB
LL
Llama 3.2 3B It Chinese Kyara
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
AT
Atomight V2.5 1.7B C1
Atomight · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
GR
granite vision 3.3 2b
Granite · ibm-granite
Params2.53B
Context128K
Q4_K_M1.5 GB
GE
Gemma 2 2B Stheno Filtered
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GL
GLM 5.3 Flash UNCENSORED
GLM · Solstice-AI
Params1.17B
Context1024K
Smallest1.3 GB
OR
Ornith 1.5 35B A3B NVFP4 MTP
Ornith · tiyuvta
Params67M
Context—
Smallest0.0 GB
HO
Home 3B v3
Home · acon96
Params2.8B
Context4K
Q4_K_M1.7 GB
FI
fishstop AI lite
Fishstop · fishstop
Params1.72B
Context40K
Q4_K_M1.1 GB
QW
Qwen3 TTS 12Hz 0.6B CustomVoice
Qwen · BricksDisplay
Params652M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 3B Instruct lora sex float16
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
AN
Anima2
Anima · JusteLeo
Params2.09B
Context—
Q4_K_M1.2 GB
BI
bitnet embedding 0.6b
Bitnet · microsoft
Params596M
Context32K
Smallest0.4 GB
LL
Llama 3.2 Korean Bllossom 3B
Llama · bartowski
Params3.21B
Context128K
Q4_K_M2.0 GB