Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
deepseek coder 1.3B kexer
DeepSeek · QuantFactory
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · duyntnet
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplay
GE
Gemma 3 1b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params1B
Context32K
Smallest0.7 GB
GGUF
OV
OvisOCR2
Ovisocr · MDfox
Params752M
Context256K
Q4_K_M0.5 GB
Vision
LI
LightOnOCR 3 0.8B
Lightonocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen2.5 Coder 0.5B
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
Coding
GR
Granite 3b Code Base
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · Andycurrent
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
rombos Replete Coder Qwen2 1.5b i1
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
FA
Falcon3 1B Instruct
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
MO
moss tts local
Moss · ilintar
Params2.23B
Context—
Smallest4.5 GB
GGUF
GR
Granite 3b Code Instruct 2k
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
CodingTool use
KI
Kimodo-SOMA-SEED-v1.1
Kimodo · LocalAI-io
Params283M
Context—
Smallest1.1 GB
GGUF
TI
py007_tinyllama-1.1b-intermediate-step-715k-1.5t
Tinyllama · TheBloke
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
NE
neutts nano q4
Neutts · neuphonic
Params229M
Context—
Smallest0.2 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · legraphista
Params1.24B
Context128K
Smallest0.4 GB
GGUF
QW
Qwen2.5 Coder 3B
Qwen · lmstudio-community
Params3.09B
Context32K
Q4_K_M1.9 GB
Coding
GE
Gemma 4 26B A4B It Assistant
Gemma · AtomicChat
Params420M
Context256K
Q4_K_M0.3 GB
GGUF
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
LL
Llama 3.2 11B Vision Instruct Abliterated
Llama · case01
Params895M
Context—
Smallest1.9 GB
GGUF
ZE
zenz v3.2 small
Zenz · Miwa-Keita
Params95M
Context1K
Smallest0.1 GB
GGUF
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
TI
Tinystories-gpt-0.1-3m
Tinystories · afrideva
Params7M
Context2K
Q4_K_M0.0 GB
GGUF
QW
online-dpo-qwen2-4
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
QW
hamo score 0.6b
Qwen · HamoAI
Params596M
Context40K
Smallest0.6 GB
GGUF
LL
Vikhr-Llama-3.2-1B-instruct
Llama · Vikhrmodels
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
AS
assert ai
Assert · erukude
Params45M
Context—
Smallest0.1 GB
GGUF
LF
LFM2 2.6B Exp
Lfm · LiquidAI
Params2.7B
Context125K
Q4_K_M1.6 GB
GGUF
GT
gte-large
Gte · opaninakuffo
Params334M
Context512
Smallest0.7 GB
GGUF

Other sizes

Keep browsing