Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B DSpark
Qwen · DimInfer
Params1.86B
Context256K
Smallest2.0 GB
GGUF
GR
GreekLlama-1.1B-it
Greekllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
DualMinded Qwen3 1.7B
Qwen · reaperdoesntknow
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
LI
LightOnOCR 3 0.8B MTP Stage
Lightonocr · staghado
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
LL
Llama 160m
Llama · QuantFactory
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LF
LFM2.5 VL 450M heretic
Lfm · saidutta69
Params354M
Context125K
Q4_K_M0.2 GB
ReasoningTool useVision
XL
xLAM 1b fc r
Xlam · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Tool use
SV
Svara Tts v1
Svara · mradermacher
Params3.3B
Context128K
Q4_K_M2.1 GB
Tool use
QW
rombos Replete Coder Qwen2 1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
QW
rokot omr 2b
Qwen · rokotmidi
Params1.72B
Context256K
Smallest1.8 GB
Vision
LL
Llama 3.2 1B Instruct
Llama · second-state
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
QW
Qwen_Qwen3 0.6B
Qwen · Alcoft
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
OP
OpenELM 1_1B Instruct Fix Nan
Openelm · mradermacher
Params1.08B
Context2K
Q4_K_M0.7 GB
GGUF
MU
multilingual e5 small gguf q8 0
Multilingual · keisuke-miyako
Params118M
Context512
Smallest0.1 GB
GGUF
LM
LMT 60 0.6B
Lmt · mradermacher
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · andrijdavid
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
GR
Granite Embedding 97m Multilingual R2
Granite · mykor
Params97M
Context32K
Q4_K_M0.1 GB
Embedding
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
NE
NVIDIA Nemotron 3.5 Super VL 120B A12B NVFP4 LiLiCorr
Nemotron · magnitudedev
Params1.66B
Context1024K
Smallest1.4 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 1.5b Bnb 4bit
Qwen · prithivMLmods
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
SA
Sarashina2.2 1b
Sarashina · mradermacher
Params1.41B
Context8K
Q4_K_M0.9 GB
GGUF
MI
Ministral 3 3B Instruct 2512 Heresy Unfiltered
Mistral · Abiray
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
MI
MiniCPM5 2B Heretic Abliterated
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
LL
Llama3.2 3B Math Gsm8K AutoSFT
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
QW
Qwen3.5 2B Uncensored Zero Refusal
Qwen · AkaumiKaede
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplayTool use
MI
Huihui Ministral 3 3B Reasoning 2512 Abliterated
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
HP
hpc coder v2 1.3b
Hpc · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
QW
Qwen3 Embedding 0.6B
Qwen · mradermacher
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingReasoningTool use
GE
gemma 2b GGUF smashed
Gemma · PrunaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Jattt6789
Params1.86B
Context256K
Smallest0.9 GB
GGUF

Other sizes

Keep browsing