Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.3 2b Instruct Heretic Safety Defiltered
Granite · mradermacher
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
MI
ghostai pro
MiniCPM · immortaltatsu
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use
LL
Hermes 3 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
RoleplayTool use
LL
DeepHermes 3 Llama 3 3B Preview
Llama · NousResearch
Params3.21B
Context128K
Smallest1.9 GB
ReasoningRoleplayTool use
GE
Gemma 3 Prompt Coder 270m It Uncensored
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Coding
PY
Pythia 1b Deduped
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.5 2B Heretic Ara
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
CodingReasoningTool use
CO
cosmo 1b
Cosmo · QuantFactory
Params1.74B
Context2K
Q4_K_M1.1 GB
GGUF
LC
LCO Embedding Omni 3B
Lco · marksverdhei
Params3.4B
Context32K
Q4_K_M2.1 GB
EmbeddingVision
AM
AmhQA_Multitask Small
Amhqa · mradermacher
Params300M
Context512
Q4_K_M0.2 GB
GGUF
QW
Qwen2.5 0.5B MoE A0.3B
Qwen · bayliner1980
Params631M
Context32K
Q4_K_M0.5 GB
Tool use
QW
Elixir Qwen2.5 Coder 3B
Qwen · mradermacher
Params3.16B
Context32K
Q4_K_M2.0 GB
CodingTool use
GE
Gemma-3-1B-It
Gemma · ThyBoof
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Huihui Gemma 3 270m It Abliterated
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
gemma 4 31b it assistant mtp
Gemma · NotMe404
Params470M
Context256K
Q4_K_M0.4 GB
GGUF
QW
Josiefied Qwen2.5 1.5B Instruct Abliterated v1
Qwen · Goekdeniz-Guelmez
Params1.5B
Context32K
Q4_K_M1.1 GB
GGUF
LL
Llm Jp 3 980m Instruct3
Llm · mmnga
Params990M
Context4K
Q4_K_M0.6 GB
GGUF
QW
Qwen2.5 Math 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
QW
Arabic Qwen3.5 OCR v4
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
SM
SmolLM2 135M Instruct heretic
SmolLM · saidutta69
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
MI
MiniCPM OCR 1.0
MiniCPM · weareapexcreators
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen2.5 0.5B Instruct Abliterated
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · gaianet
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
AN
Anime Llasa 3B
Anime · mradermacher
Params3.41B
Context128K
Q4_K_M2.2 GB
Tool use
OL
AMD OLMo 1B IT
OLMo · mradermacher
Params1.18B
Context2K
Q4_K_M0.7 GB
GGUF
LF
LFM3 Omni 2B
Lfm · prithivMLmods
Params1.73B
Context125K
Q4_K_M1.1 GB
CodingReasoningTool use
QW
Qwen Qwen2.5 0.5B Instruct
Qwen · tensorblock
Params494M
Context32K
Smallest0.3 GB
Tool use
ZW
ZwZ 2B
Zwz · mradermacher
Params2.03B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
OL
olio
Olio · DefiOlio
Params2.7B
Context40K
Smallest1.1 GB
GGUF
GE
Gemma 4 Unified 0.8B Tiny
Gemma · mradermacher
Params754M
Context256K
Q4_K_M0.6 GB
ReasoningTool useVision

Other sizes

Keep browsing