Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
IN
index echo 2b
Index · cstr
Params1.88B
Context—
Smallest0.7 GB
GGUF
GR
Granite-4.0-350M
Granite · unsloth
Params352M
Context32K
Q4_K_M0.2 GB
GGUF
QW
Qwen2.5 Coder 3B Instruct
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
ST
stable diffusion v1 5
Stable · gpustack
Params1.07B
Context—
Smallest1.7 GB
GGUF
EU
EuroLLM 1.7B Instruct
Eurollm · mradermacher
Params1.66B
Context8K
Q4_K_M1.0 GB
GGUF
PA
Parakeet TDT-CTC 1.1B
Parakeet · handy-computer
Params1.07B
Context—
Q4_K_M0.8 GB
GGUF
QW
Qwen3.8 27B
Qwen · Jackrong
Params461M
Context256K
Q4_K_M16.8 GB
Vision
PH
phonon 31m en audiocpp
Phonon · gradium
Params41M
Context—
Smallest0.1 GB
GGUF
DE
deepseek-ai_deepseek-coder-1.3b-base
DeepSeek · TheBloke
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
LL
Dolphin 3.0 Llama 3.2 1b
Llama · bartowski
Params1.24B
Context128K
Q4_K_M0.8 GB
CodingTool use
DE
DeepSeek V4.1 Flash 1017 Uncensored
DeepSeek · AtomicChat
Params115M
Context—
Smallest0.5 GB
GGUF
SM
SmolVLM2-256M-Video-Instruct
Smolvlm · ggml-org
Params163M
Context8K
Q4_K_M0.1 GB
Vision
QW
Qwen2.5 1.5b
Qwen · ElementMerc
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
PH
phonon 40m en
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
IM
imgmodel
Imgmodel · koboldcpp
Params3.47B
Context40K
Q4_K_M2.5 GB
Vision
OV
OvisOCR3
Ovisocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
LF
LFM2.5 2.6B Heretic Abliterated
Lfm · Abiray
Params2.7B
Context125K
Q4_K_M1.7 GB
GGUF
NE
nexus finance
Nexus · King3Djbl
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF
HU
HunyuanOCR
Hunyuanocr · ggml-org
Params539M
Context32K
Smallest0.6 GB
Vision
MO
moondream2
Moondream · ggml-org
Params1.42B
Context2K
Smallest2.8 GB
Vision
FL
FLUX.1 schnell
Flux · second-state
Params84M
Context—
Smallest0.1 GB
GGUF
QW
Huihui Qwen3.5 0.8B abliterated claude mythos distilled 25k
Qwen · azminawwar
Params773M
Context256K
Q4_K_M0.5 GB
ReasoningTool useVision
QW
Qwen2.5 Coder 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
PH
phonon 40m es
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
PH
phonon 40m multilingual
Phonon · gradium
Params51M
Context—
Smallest0.1 GB
GGUF
LL
Llama 3.2 1B Instruct Uncensored
Llama · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
SM
SmolLM2 135M
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
IN
InternVL3_5 2B
Internvl · bartowski
Params2.03B
Context40K
Q4_K_M1.3 GB
Vision
LL
LIama 3.2 test
Llama · bhanuripranathi
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
QW
Qwen2.5 Coder 1.5B
Qwen · ggml-org
Params1.54B
Context32K
Smallest1.6 GB
Coding

Other sizes

Keep browsing