Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
GR
Granite 3.3 2b Instruct Heretic Safety Defiltered
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
MI
ghostai pro
MiniCPM · immortaltatsu
Params2.52B
Context128K
Q4_K_M1.6 GB
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
LL
DeepHermes 3 Llama 3 3B Preview
Llama · NousResearch
Params3.21B
Context128K
Smallest1.9 GB
GE
Gemma 3 Prompt Coder 270m It Uncensored
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
QW
Qwen3.5 2B Heretic Ara
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
CO
cosmo 1b
Cosmo · QuantFactory
Params1.74B
Context2K
Q4_K_M1.1 GB
LC
LCO Embedding Omni 3B
Lco · marksverdhei
Params3.4B
Context32K
Q4_K_M2.1 GB
AM
AmhQA_Multitask Small
Amhqa · mradermacher
Params300M
Context512
Q4_K_M0.2 GB
QW
Qwen2.5 0.5B MoE A0.3B
Qwen · bayliner1980
Params631M
Context32K
Q4_K_M0.5 GB
QW
Elixir Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.16B
Context32K
Q4_K_M2.0 GB
GE
Gemma-3-1B-It
Gemma · ThyBoof
Params1B
Context32K
Q4_K_M0.8 GB
GE
Huihui Gemma 3 270m It Abliterated
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GE
gemma 4 31b it assistant mtp
Gemma · NotMe404
Params470M
Context256K
Q4_K_M0.4 GB
QW
Josiefied Qwen2.5 1.5B Instruct Abliterated v1
Qwen · Goekdeniz-Guelmez
Params1.5B
Context32K
Q4_K_M1.1 GB
LL
Llm Jp 3 980m Instruct3
Llm · mmnga
Params990M
Context4K
Q4_K_M0.6 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
QW
Arabic Qwen3.5 OCR v4
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
SM
SmolLM2 135M Instruct heretic
SmolLM · saidutta69
Params135M
Context8K
Q4_K_M0.1 GB
MI
MiniCPM OCR 1.0
MiniCPM · weareapexcreators
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 0.5B Instruct Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
AN
Anime Llasa 3B
Anime · mradermacher
Params3.41B
Context128K
Q4_K_M2.2 GB
OL
AMD OLMo 1B IT
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
LF
LFM3 Omni 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
QW
Qwen Qwen2.5 0.5B Instruct
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
ZW
ZwZ 2B
Zwz · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
OL
olio
Olio · DefiOlio
Params2.7B
Context40K
Smallest1.1 GB
GE
Gemma 4 Unified 0.8B Tiny
Gemma · mradermacher
Params754M
Context256K
Q4_K_M0.6 GB