Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
JI
Jina Embeddings v5 Text Nano Text Matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
LF
LFM3-VL-2B
Lfm · lmstudio-community
Params1.73B
Context125K
Q4_K_M1.1 GB
BG
Bge Small En v1.5
BGE · ggml-org
Params33M
Context512
Smallest0.0 GB
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · LiquidAI
Params328M
Context125K
Q4_K_M0.2 GB
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mmnga
Params3.36B
Context8K
Q4_K_M2.1 GB
JA
NT Java 1.1B
Java · InfosysEnterprise
Params1.24B
Context8K
Q4_K_M0.8 GB
MA
manaca 1b base
Manaca · NANI-Nithin
Params1.72B
Context4K
Q4_K_M1.1 GB
SD
sdxs 512 tinySDdistilled
Sdxs · concedo
Params441M
Context—
Smallest0.7 GB
LF
LFM2.5 1.2B JP 202606
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · bocalan
Params3.09B
Context32K
Q4_K_M1.9 GB
AN
anything v5
Anything · genai-archive
Params1.07B
Context—
Smallest1.6 GB
RE
Realistic Vision V6.0 B1
Realistic · second-state
Params1.07B
Context—
Smallest1.5 GB
GE
t5gemma-b-b-ul2 tokenizer (Gemma BPE)
Gemma · thepatch
Params282M
Context—
Smallest0.0 GB
CA
canary ctc aligner
Canary · cstr
Params626M
Context—
Smallest0.4 GB
NO
nomic-embed-text-v1.5
Nomic · second-state
Params137M
Context2K
Q4_K_M0.1 GB
GE
Gemma-3-270M-It-Qat
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
JI
Jina Embeddings v5 Text Nano Classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
PO
Pony Diffusion V6 XL
Pony · morikomorizz
Params2.57B
Context—
Smallest2.7 GB
TO
tolkio models
Tolkio · datacrunch
Params1.94B
Context256K
Smallest0.6 GB
NO
Nora0.1 1.7B
Nora · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
JI
Jina Embeddings v5 Text Small Clustering
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
LF
LFM3 1.7B Heretic Abliterated
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
WH
whisper large v3 turbo
Whisper · oxide-lab
Params809M
Context—
Smallest0.3 GB
PH
phi 2 electrical engineering
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.7 GB
GU
GUI Owl 1.5 2B Instruct
Gui · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
QW
Qwen3 1.7B Abliterated
Qwen · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
PA
PaddleOCR-VL-1.6
Paddleocr · Mungert
Params467M
Context128K
Q4_K_M0.4 GB
NE
neutts air q4
Neutts · neuphonic
Params748M
Context—
Smallest0.5 GB
QW
EUAIAct Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Q4_K_M0.4 GB
IN
InternVL3 1B Instruct
Internvl · ggml-org
Params630M
Context32K
Smallest0.7 GB