Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
tinyllamas BE
Tinyllamas · taronaeo
Params24M
Context—
Smallest0.0 GB
GGUF
IN
Intellect V0.3 1.6B i1
Intellect · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
Reasoning
DE
DeepSeek R1 Distill Qwen 1.5B OBLITERATED
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
ReasoningTool use
RA
raspberry 3B
Raspberry · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
ME
MedPsy 1.7B
Medpsy · qvac
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
MI
Ministral 3 3B Instruct 2512 Roleplay Tuned ERP Tolerant
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
RoleplayTool use
GE
Gemma-3-270M-It
Gemma · Sci-fi-vy
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
RI
RimTalk Mini v1
Rimdialogue · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen3.8 2B Function Calling xLAM
Qwen · tinyopsec
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
SM
Smaug AI Image Detector
Smaug · mradermacher
Params271M
Context256K
Q4_K_M0.2 GB
Vision
QW
Qwen2.5 Coder 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
CodingTool use
WE
WeMM Embedding 2B
Wemm · DreamBlooms
Params2.39B
Context256K
Q4_K_M1.6 GB
EmbeddingVision
VI
RefinedToolCallV5 3b
Vibethinker · RefinedNeuro
Params3.09B
Context128K
Smallest2.5 GB
ReasoningTool use
BG
bge large en i1
BGE · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
Embedding
ST
Starlight Pro 1
Starlight · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool use
BA
BabyHercules 8x150M
Babyhercules · mradermacher
Params751M
Context2K
Q4_K_M0.5 GB
GGUF
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
GGUF
FR
french-llm-from-scratch
French · vincent-pro-ai
Params320M
Context1K
Q4_K_M0.2 GB
GGUF
QW
openwispr cleanup qwen3 0.6b
Qwen · rohitag13
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
FU
distil home assistant functiongemma
Functiongemma · distil-labs
Params596M
Context40K
Smallest2.4 GB
Tool use
QW
godot qwen2.5 coder 3b instruct
Qwen · bekoozkan
Params3.09B
Context32K
Q4_K_M1.9 GB
CodingTool use
GE
Gemma 2 2b It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
Qwen2 Math 1.5B Instruct
Qwen · bartowski
Params1.54B
Context4K
Q4_K_M1.0 GB
GGUF
IN
Infinity Parser2 Flash
Infinity · prithivMLmods
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
JO
JOSIE 2 2B OSS
Josie · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
ReasoningTool useVision
QW
Qwen1.5B Instruct Upscale 3.5B
Qwen · mradermacher
Params3.46B
Context32K
Q4_K_M2.1 GB
GGUF
LL
llm 3 2 flux prompt
Llama · ABDALLALSWAITI
Params3.21B
Context128K
Smallest3.4 GB
GGUF
ZE
zenz v3.1 small mixed input
Zenz · motchii709
Params91M
Context1K
Smallest0.1 GB
GGUF
NA
Nara Lightonocr 3 0.8b
Nara · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
MI
pjev 2b
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB
ReasoningTool use

Other sizes

Keep browsing