Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen2.5 VL Abliterated Caption
Qwen · prithivMLmods
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
AA
aac board generator 770m ptbr
Aac · tardellirs
Params772M
Context32K
Q4_K_M0.6 GB
GGUF
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LT
LTX Video 0.9.5
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GGUF
GP
openai community gpt2 GGUF smashed
Gpt · PrunaAI
Params124M
Context1K
Q4_K_M0.1 GB
GGUF
JI
jina reranker v1 tiny en
Jina · gpustack
Params33M
Context8K
Q4_K_M0.0 GB
CodingEmbedding
HE
Helvete Nano
Helvete · Xetro
Params1.88B
Context1024K
Q4_K_M1.3 GB
Roleplay
QW
gte-Qwen2-1.5B-instruct
Qwen · RichardErkhov
Params1.78B
Context128K
Q4_K_M1.1 GB
GGUF
DO
dots tts soar
Dots · cstr
Params2.2B
Context—
Smallest0.0 GB
GGUF
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · unsloth
Params494M
Context32K
Q4_K_M0.4 GB
Coding
SU
SurgeGlobal OpenBezoar HH RLHF SFT
Surgeglobal · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · lmstudio-community
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GE
Gemma 4 31B It DFlash
Gemma · Anbeeld
Params1.54B
Context256K
Q4_K_M0.9 GB
GGUF
LF
lfm2.5 2.6B thinkingcap distiller v2
Lfm · Davd-b01
Params2.7B
Context128K
Q4_K_M1.7 GB
Reasoning
QW
Qwen2.5 3B Instruct
Qwen · QuantFactory
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
MO
Moonshine Base
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
GGUF
LL
Llama3.2 3B Explained
Llama · theprint
Params3.2B
Context128K
Q4_K_M2.0 GB
GGUF
AR
ARK 270M Instruct i1
Ark · usermma
Params252M
Context2K
Q4_K_M0.2 GB
GGUF
PH
phi 2 layla v1 chatml
Phi · l3utterfly
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
FA
FableForge
Fableforge · fableforge-ai
Params1.54B
Context32K
Q4_K_M1.1 GB
Reasoning
ST
stable diffusion v2 1 turbo
Stable · gpustack
Params1.29B
Context—
Smallest2.2 GB
GGUF
NE
nexus security
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
QW
Qwen_Qwen3 1.7B
Qwen · Alcoft
Params2.03B
Context40K
Q4_K_M1.3 GB
ReasoningTool use
GE
Gemma 4 31B It Assistant
Gemma · AtomicChat
Params470M
Context256K
Q4_K_M0.4 GB
GGUF
QW
Qwen3 TTS 12Hz 0.6B
Qwen · BricksDisplay
Params661M
Context32K
Q4_K_M0.4 GB
GGUF
HU
hy3d
Hunyuan · calcuis
Params1.11B
Context—
Q4_K_M0.6 GB
GGUF
QW
Qwen2.5 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use

Other sizes

Keep browsing