Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · duyntnet
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
GE
Gemma 3 1b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params1B
Context32K
Smallest0.7 GB
OV
OvisOCR2
Ovisocr · MDfox
Params752M
Context256K
Q4_K_M0.5 GB
LI
LightOnOCR 3 0.8B
Lightonocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen2.5 Coder 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GR
Granite 3b Code Base
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · Andycurrent
Params596M
Context40K
Q4_K_M0.4 GB
QW
rombos Replete Coder Qwen2 1.5b i1
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
FA
Falcon3 1B Instruct
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
MO
moss tts local
Moss · ilintar
Params2.23B
Context—
Smallest4.5 GB
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
KI
Kimodo-SOMA-SEED-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
TI
py007_tinyllama-1.1b-intermediate-step-715k-1.5t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
NE
neutts nano q4
Neutts · neuphonic
Params229M
Context—
Smallest0.2 GB
LL
Llama 3.2 1B Instruct
Llama · legraphista
Params1.24B
Context128K
Smallest0.4 GB
QW
Qwen2.5 Coder 3B
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
GE
Gemma 4 26B A4B It Assistant
Gemma · AtomicChat
Params420M
Context256K
Q4_K_M0.3 GB
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
LL
Llama 3.2 11B Vision Instruct Abliterated
Llama · case01
Params895M
Context—
Smallest1.9 GB
ZE
zenz v3.2 small
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
TI
Tinystories-gpt-0.1-3m
Tinystories · afrideva
Params7M
Context2K
Q4_K_M0.0 GB
QW
online-dpo-qwen2-4
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
QW
hamo score 0.6b
Qwen · HamoAI
Params596M
Context40K
Smallest0.6 GB
LL
Vikhr-Llama-3.2-1B-instruct
Llama · Vikhrmodels
Params1.24B
Context128K
Q4_K_M0.8 GB
AS
assert ai
Assert · erukude
Params45M
Context—
Smallest0.1 GB
LF
LFM2 2.6B Exp
Lfm · LiquidAI
Params2.7B
Context125K
Q4_K_M1.6 GB
GT
gte-large
Gte · opaninakuffo
Params334M
Context512
Smallest0.7 GB