Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
IN
index echo 2b
Index · cstr
Params1.88B
Context—
Smallest0.7 GB
GR
Granite-4.0-350M
Granite · unsloth
Params352M
Context32K
Q4_K_M0.2 GB
QW
Qwen2.5 Coder 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
ST
stable diffusion v1 5
Stable · gpustack
Params1.07B
Context—
Smallest1.7 GB
EU
EuroLLM 1.7B Instruct
Eurollm · mradermacher
Params1.66B
Context8K
Q4_K_M1.0 GB
PA
Parakeet TDT-CTC 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
QW
Qwen3.8 27B
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
PH
phonon 31m en audiocpp
Phonon · gradium
Params41M
Context—
Smallest0.1 GB
DE
deepseek-ai_deepseek-coder-1.3b-base
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
LL
Dolphin 3.0 Llama 3.2 1b
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · AtomicChat
Params115M
Context—
Smallest0.5 GB
SM
SmolVLM2-256M-Video-Instruct
Smolvlm · ggml-org
Params163M
Context8K
Q4_K_M0.1 GB
QW
Qwen2.5 1.5b
Qwen · ElementMerc
Params1.54B
Context32K
Q4_K_M1.0 GB
PH
phonon 40m en
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
IM
imgmodel
Imgmodel · koboldcpp
Params3.47B
Context40K
Q4_K_M2.5 GB
OV
OvisOCR3
Ovisocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
LF
LFM2.5 2.6B Heretic Abliterated
Lfm · Abiray
Params2.7B
Context125K
Q4_K_M1.7 GB
NE
nexus finance
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
HU
HunyuanOCR
Hunyuanocr · ggml-org
Params539M
Context32K
Smallest0.6 GB
MO
moondream2
Moondream · ggml-org
Params1.42B
Context2K
Smallest2.8 GB
FL
FLUX.1 schnell
Flux · second-state
Params84M
Context—
Smallest0.1 GB
QW
Huihui Qwen3.5 0.8B abliterated claude mythos distilled 25k
Qwen · azminawwar
Params773M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
PH
phonon 40m es
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
PH
phonon 40m multilingual
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
LL
Llama 3.2 1B Instruct Uncensored
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
SM
SmolLM2 135M
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
IN
InternVL3_5 2B
Internvl · bartowski
Params2.03B
Context40K
Q4_K_M1.3 GB
LL
LIama 3.2 test
Llama · bhanuripranathi
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
Qwen2.5 Coder 1.5B
Qwen · ggml-org
Params1.54B
Context32K
Smallest1.6 GB