Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
JI
Jina Embeddings v5 Text Nano Text Matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
LF
LFM3-VL-2B
Lfm · lmstudio-community
Params1.73B
Context125K
Q4_K_M1.1 GB
ReasoningTool useVision
BG
Bge Small En v1.5
BGE · ggml-org
Params33M
Context512
Smallest0.0 GB
Embedding
LF
LFM2.5 8B A1B DSpark Draft v1
Lfm · LiquidAI
Params328M
Context125K
Q4_K_M0.2 GB
GGUF
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mmnga
Params3.36B
Context8K
Q4_K_M2.1 GB
GGUF
JA
NT Java 1.1B
Java · InfosysEnterprise
Params1.24B
Context8K
Q4_K_M0.8 GB
Coding
MA
manaca 1b base
Manaca · NANI-Nithin
Params1.72B
Context4K
Q4_K_M1.1 GB
GGUF
SD
sdxs 512 tinySDdistilled
Sdxs · concedo
Params441M
Context—
Smallest0.7 GB
GGUF
LF
LFM2.5 1.2B JP 202606
Lfm · LiquidAI
Params1.17B
Context125K
Q4_K_M0.7 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · bocalan
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
AN
anything v5
Anything · genai-archive
Params1.07B
Context—
Smallest1.6 GB
GGUF
RE
Realistic Vision V6.0 B1
Realistic · second-state
Params1.07B
Context—
Smallest1.5 GB
GGUF
GE
t5gemma-b-b-ul2 tokenizer (Gemma BPE)
Gemma · thepatch
Params282M
Context—
Smallest0.0 GB
GGUF
CA
canary ctc aligner
Canary · cstr
Params626M
Context—
Smallest0.4 GB
GGUF
NO
nomic-embed-text-v1.5
Nomic · second-state
Params137M
Context2K
Q4_K_M0.1 GB
Embedding
GE
Gemma-3-270M-It-Qat
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
JI
Jina Embeddings v5 Text Nano Classification
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
CodingEmbedding
PO
Pony Diffusion V6 XL
Pony · morikomorizz
Params2.57B
Context—
Smallest2.7 GB
GGUF
TO
tolkio models
Tolkio · datacrunch
Params1.94B
Context256K
Smallest0.6 GB
ReasoningTool use
NO
Nora0.1 1.7B
Nora · mradermacher
Params1.72B
Context40K
Q4_K_M1.1 GB
ReasoningRoleplayTool use
JI
Jina Embeddings v5 Text Small Clustering
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
LF
LFM3 1.7B Heretic Abliterated
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
WH
whisper large v3 turbo
Whisper · oxide-lab
Params809M
Context—
Smallest0.3 GB
GGUF
PH
phi 2 electrical engineering
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
GU
GUI Owl 1.5 2B Instruct
Gui · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
Vision
QW
Qwen3 1.7B Abliterated
Qwen · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB
GGUF
PA
PaddleOCR-VL-1.6
Paddleocr · Mungert
Params467M
Context128K
Q4_K_M0.4 GB
Vision
NE
neutts air q4
Neutts · neuphonic
Params748M
Context—
Smallest0.5 GB
GGUF
QW
EUAIAct Qwen2.5 0.5B Edge
Qwen · sallani
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
IN
InternVL3 1B Instruct
Internvl · ggml-org
Params630M
Context32K
Smallest0.7 GB
Vision

Other sizes

Keep browsing