Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
TI
tinyllamas BE
Tinyllamas · taronaeo
Params24M
Context—
Smallest0.0 GB
IN
Intellect V0.3 1.6B i1
Intellect · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
DE
DeepSeek R1 Distill Qwen 1.5B OBLITERATED
DeepSeek · mradermacher
Params1.78B
Context128K
Q4_K_M1.1 GB
RA
raspberry 3B
Raspberry · bartowski
Params3.09B
Context32K
Q4_K_M1.9 GB
ME
MedPsy 1.7B
Medpsy · qvac
Params2.03B
Context40K
Q4_K_M1.3 GB
MI
Ministral 3 3B Instruct 2512 Roleplay Tuned ERP Tolerant
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GE
Gemma-3-270M-It
Gemma · Sci-fi-vy
Params268M
Context32K
Q4_K_M0.3 GB
RI
RimTalk Mini v1
Rimdialogue · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen3.8 2B Function Calling xLAM
Qwen · tinyopsec
Params1.94B
Context256K
Q4_K_M1.3 GB
SM
Smaug AI Image Detector
Smaug · mradermacher
Params271M
Context256K
Q4_K_M0.2 GB
QW
Qwen2.5 Coder 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
WE
WeMM Embedding 2B
Wemm · DreamBlooms
Params2.39B
Context256K
Q4_K_M1.6 GB
VI
RefinedToolCallV5 3b
Vibethinker · RefinedNeuro
Params3.09B
Context128K
Smallest2.5 GB
BG
bge large en i1
BGE · mradermacher
Params334M
Context512
Q4_K_M0.2 GB
ST
Starlight Pro 1
Starlight · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
BA
BabyHercules 8x150M
Babyhercules · mradermacher
Params751M
Context2K
Q4_K_M0.5 GB
OL
Olmo-2-0425-1B-Instruct
OLMo · unsloth
Params1.48B
Context4K
Q4_K_M0.9 GB
FR
french-llm-from-scratch
French · vincent-pro-ai
Params320M
Context1K
Q4_K_M0.2 GB
QW
openwispr cleanup qwen3 0.6b
Qwen · rohitag13
Params596M
Context40K
Q4_K_M0.4 GB
FU
distil home assistant functiongemma
Functiongemma · distil-labs
Params596M
Context40K
Smallest2.4 GB
QW
godot qwen2.5 coder 3b instruct
Qwen · bekoozkan
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
Gemma 2 2b It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
Qwen2 Math 1.5B Instruct
Qwen · bartowski
Params1.54B
Context4K
Q4_K_M1.0 GB
IN
Infinity Parser2 Flash
Infinity · prithivMLmods
Params1.88B
Context256K
Q4_K_M1.3 GB
JO
JOSIE 2 2B OSS
Josie · mradermacher
Params1.94B
Context256K
Q4_K_M1.3 GB
QW
Qwen1.5B Instruct Upscale 3.5B
Qwen · mradermacher
Params3.46B
Context32K
Q4_K_M2.1 GB
LL
llm 3 2 flux prompt
Llama · ABDALLALSWAITI
Params3.21B
Context128K
Smallest3.4 GB
ZE
zenz v3.1 small mixed input
Zenz · motchii709
Params91M
Context1K
Smallest0.1 GB
NA
Nara Lightonocr 3 0.8b
Nara · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
MI
pjev 2b
MiniCPM · tinyopsec
Params2.52B
Context128K
Q4_K_M1.6 GB