Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
SP
Spark X2.6 1.7B
Spark · XHToken
Params1.98B
Context1024K
Q4_K_M1.8 GB
ReasoningTool use
MI
MiniCPM5 1B
MiniCPM · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
GGUF
CH
chatterbox
Chatterbox · cstr
Params264M
Context—
Smallest0.0 GB
GGUF
QW
Qwen_Qwen3 0.6B
Qwen · lmstudio-community
Params752M
Context40K
Q4_K_M0.5 GB
GGUF
DE
DeepScaleR 1.5B Preview
Deepscaler · bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
JI
Jina Embeddings v5 Text Small Text Matching
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
QW
Qwen3.5 0.8B Claude 4.6 Opus Reasoning Distilled
Qwen · Jackrong
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningVision
QW
Qwen2.5 0.5B Instruct
Qwen · ThomasBaruzier
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
WA
WAI NSFW illustrious SDXL v110
Wai · kekusprod
Params2.57B
Context—
Smallest1.5 GB
GGUF
CU
CursorCore DS 1.3B SR i1
Cursorcore · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
QW
Qwen3.8 27B Flash MTP
Qwen · SuperLogic
Params461M
Context256K
Smallest6.2 GB
CodingVision
QW
Qwen3.5 2B Uncensored Zero Refusal SOMA
Qwen · AkaumiKaede
Params1.88B
Context256K
Q4_K_M1.3 GB
RoleplayVision
LF
LFM3-1.7B
Lfm · AtomicChat
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
LU
lumina
Lumina · calcuis
Params2.61B
Context—
Q4_K_M1.5 GB
GGUF
QW
Qwen25 Coder 3b Claude
Qwen · ryzdfm
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingReasoning
QW
Rice Cracker Qwen3.5 0.8B Abliterated Base
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Coding
OV
OvisOCR2
Ovisocr · Abiray
Params752M
Context256K
Q4_K_M0.5 GB
Vision
SM
TwIL LM
SmolLM · webAI-Official
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning
OP
OpenELM 3B Instruct
Openelm · mradermacher
Params3.04B
Context2K
Q4_K_M1.9 GB
GGUF
LF
LFM3 1.7B Heretic Abliterated i1
Lfm · Vortecks
Params1.73B
Context256K
Q4_K_M1.1 GB
ReasoningTool use
LA
speechbrain/lang-id-voxlingua107-ecapa
Lang · handy-computer
Params21M
Context—
Smallest0.0 GB
GGUF
GL
GLM 5.3 Flash DFlash2
GLM · Anbeeld
Params1.17B
Context1024K
Q4_K_M0.7 GB
GGUF
LL
Llama 3.2 3B Instruct
Llama · legraphista
Params3.21B
Context128K
Smallest0.9 GB
GGUF
JE
Jev-Style-2B-Decision-v3
Jev · chaoliangUNSW
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
MI
Ministral 3 3B Reasoning 2512
Mistral · mistralai
Params3.43B
Context256K
Q4_K_M2.1 GB
ReasoningVision
OR
Ornith 1.5 122B DFlash2
Ornith · kaivoss
Params930M
Context256K
Q4_K_M0.6 GB
GGUF
LI
LightOnOCR 3 0.8B
Lightonocr · Prathat
Params752M
Context256K
Q4_K_M0.5 GB
Vision
LL
Llama 3.2 1B Instruct
Llama · DavidAU
Params1.24B
Context128K
Q4_K_M0.8 GB
Roleplay
LI
LightOnOCR 3 0.8B
Lightonocr · prithivMLmods
Params752M
Context256K
Q4_K_M0.5 GB
Vision
PH
dolphin 2 6 phi 2
Phi · TheBloke
Params2.78B
Context2K
Q4_K_M1.8 GB
CodingTool use

Other sizes

Keep browsing