Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
jina embeddings v5 omni small text matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
QW
Qwen2.5 Coder 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
DI
distil whisper large v3
Distil · FL33TW00D-HF
Params756M
Context—
Smallest0.4 GB
GGUF
GT
Gte Multilingual Reranker Base
Gte · gpustack
Params306M
Context8K
Q4_K_M0.2 GB
Embedding
GE
models--google--gemma-2b
Gemma · MaziyarPanahi
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
DE
deeseek r1 1.5b ft 1 q4 k m
Deeseek · maharshpatelx
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
DE
DeepSeek-OCR
DeepSeek · NexaAI
Params2.93B
Context—
Smallest1.7 GB
GGUF
GE
Gemma 3 1b It Abliterated
Gemma · mlabonne
Params1B
Context32K
Q4_K_M0.8 GB
Vision
QW
Qwen2.5 1.5B K2 3.34bpw
Qwen · TitanMamo10
Params596M
Context128K
Smallest1.2 GB
Tool use
UD
Udgam-384M-Base
Udgam · udgamlabs
Params384M
Context2K
Smallest0.4 GB
ReasoningTool use
GR
Granite Docling 258M
Granite · ibm-granite
Params164M
Context8K
Smallest0.3 GB
Vision
SM
Smollm2 1.7b Uncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.5 2B Uncensored Ara
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
QW
Qwen2 1.5B Spanish 1.0
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
gutsy
Qwen · kouhxp
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
DE
DeepSeek R1 Distill Qwen 1.5B
DeepSeek · QuantFactory
Params1.78B
Context128K
Q4_K_M1.1 GB
Reasoning
GR
Granite 4.0 H 350m
Granite · mrutkows
Params340M
Context1024K
Q4_K_M0.2 GB
Tool use
QW
youtube audiobook title parser
Qwen · Salahin
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
Tool useVision
D1
d1 2B
AtomicChat
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
MU
Muse Glimmer 30B Uncensored Heretic
Muse · cvgro
Params2.77B
Context128K
Q4_K_M16.9 GB
ReasoningTool useVision
JI
jina embeddings v2 base en
Jina · second-state
Params137M
Context8K
Q4_K_M0.1 GB
CodingEmbedding
QW
Qwen2.5 VL 3B Instruct
Qwen · Taoufik
Params3.09B
Context125K
Q4_K_M1.9 GB
Tool useVision
MI
timestral cpp
Mistral · mudler
Params123M
Context32K
Smallest0.0 GB
GGUF
QW
Qwen3 1.7B Coder Distilled SFT
Qwen · tinyopsec
Params2.03B
Context40K
Q4_K_M1.3 GB
CodingReasoningTool use
IN
Intern Decision 2B
InternLM · bombdefuser-124
Params1.88B
Context256K
Smallest2.0 GB
ReasoningTool useVision
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
FL
Flint-DFlash2
Flint · incoai
Params403M
Context256K
Q4_K_M0.2 GB
ReasoningTool use
FL
Fluxnat Coder 3B
Fluxnat · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
AT
Atlas Chat 2B
Atlas · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Other sizes

Keep browsing