Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
Qwen2.5 VL Abliterated Caption
Qwen · prithivMLmods
Params3.09B
Context125K
Q4_K_M1.9 GB
AA
aac board generator 770m ptbr
Aac · tardellirs
Params772M
Context32K
Q4_K_M0.6 GB
GR
Granite 3.3 2b Instruct
Granite · bartowski
Params2.53B
Context128K
Q4_K_M1.5 GB
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
LT
LTX Video 0.9.5
Ltx · city96
Params1.92B
Context—
Q4_K_M1.3 GB
GP
openai community gpt2 GGUF smashed
Gpt · PrunaAI
Params124M
Context1K
Q4_K_M0.1 GB
JI
jina reranker v1 tiny en
Jina · gpustack
Params33M
Context8K
Q4_K_M0.0 GB
HE
Helvete Nano
Helvete · Xetro
Params1.88B
Context1024K
Q4_K_M1.3 GB
QW
gte-Qwen2-1.5B-instruct
Qwen · RichardErkhov
Params1.78B
Context128K
Q4_K_M1.1 GB
DO
dots tts soar
Dots · cstr
Params2.2B
Context—
Smallest0.0 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · unsloth
Params494M
Context32K
Q4_K_M0.4 GB
SU
SurgeGlobal OpenBezoar HH RLHF SFT
Surgeglobal · RichardErkhov
Params3.43B
Context2K
Q4_K_M2.6 GB
SM
SmolLM 360M Instruct
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · lmstudio-community
Params494M
Context32K
Q4_K_M0.4 GB
GE
Gemma 4 31B It DFlash
Gemma · Anbeeld
Params1.54B
Context256K
Q4_K_M0.9 GB
LF
lfm2.5 2.6B thinkingcap distiller v2
Lfm · Davd-b01
Params2.7B
Context128K
Q4_K_M1.7 GB
QW
Qwen2.5 3B Instruct
Qwen · QuantFactory
Params3.1B
Context32K
Q4_K_M1.9 GB
MO
Moonshine Base
Moonshine · handy-computer
Params62M
Context—
Smallest0.1 GB
LL
Llama3.2 3B Explained
Llama · theprint
Params3.2B
Context128K
Q4_K_M2.0 GB
AR
ARK 270M Instruct i1
Ark · usermma
Params252M
Context2K
Q4_K_M0.2 GB
PH
phi 2 layla v1 chatml
Phi · l3utterfly
Params2.78B
Context2K
Q4_K_M1.7 GB
QW
Qwen2.5 1.5B Instruct
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
FableForge
Fableforge · fableforge-ai
Params1.54B
Context32K
Q4_K_M1.1 GB
ST
stable diffusion v2 1 turbo
Stable · gpustack
Params1.29B
Context—
Smallest2.2 GB
NE
nexus security
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen_Qwen3 1.7B
Qwen · Alcoft
Params2.03B
Context40K
Q4_K_M1.3 GB
GE
Gemma 4 31B It Assistant
Gemma · AtomicChat
Params470M
Context256K
Q4_K_M0.4 GB
QW
Qwen3 TTS 12Hz 0.6B
Qwen · BricksDisplay
Params661M
Context32K
Q4_K_M0.4 GB
HU
hy3d
Hunyuan · calcuis
Params1.11B
Context—
Q4_K_M0.6 GB
QW
Qwen2.5 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB