Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
granite embedding 125m english
Granite · bartowski
Params124M
Context512
Q4_K_M0.1 GB
Embedding
ST
stable-code-instruct-3b
Stable · stabilityai
Params2.8B
Context16K
Q4_K_M1.7 GB
Coding
WA
wan 1.3b
Wan · bykhan
Params127M
Context—
Q4_K_M1.0 GB
GGUF
OL
OLMo 1B 0724 Hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
GE
anon 1b
Gemma · scratchyone
Params1B
Context32K
Smallest2.0 GB
GGUF
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GGUF
ST
stable diffusion 3.5 medium turbo
Stable · tensorart
Params2.47B
Context—
Q4_K_M1.8 GB
GGUF
LF
LFM2 2.6B Transcript
Lfm · LiquidAI
Params2.57B
Context125K
Q4_K_M1.6 GB
GGUF
FL
FLOR 1.3B Instructed
Flor · xaviviro
Params1.41B
Context4K
Q4_K_M0.9 GB
GGUF
HO
K2 Horizon 0.9B
Horizon · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
GGUF
GA
GameScaling 2B S3
Gamescaling · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
ReasoningTool useVision
OR
Ornith 1.5 35B A3B BigBang MTP
Ornith · EryriLabs
Params1.86B
Context256K
Q4_K_M21.2 GB
GGUF
NA
Nano.Imp Creative.Writing Heretic 3.2 1B
Nano · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
MI
Minimax Music3
Minimax · molbal
Params2.46B
Context—
Smallest1.5 GB
GGUF
RE
realvisxl v5.0 lightning
Realvisxl · off-grid-ai
Params3.47B
Context—
Smallest2.8 GB
GGUF
DA
danube2-1.8b-CodeFeedback
Danube · mradermacher
Params1.83B
Context8K
Q4_K_M1.1 GB
Coding
QW
Qwen2.5 Coder 1.5B
Qwen · QuantFactory
Params1.54B
Context32K
Q4_K_M1.0 GB
Coding
LL
llama nemotron embed 1b v2
Llama · sabafallah
Params1.24B
Context128K
Q4_K_M0.8 GB
Embedding
LF
LFM2.5 2.6B Tema_Q Abliterated
Lfm · mradermacher
Params2.7B
Context128K
Q4_K_M1.7 GB
GGUF
AA
aac pictogram retriever ptbr
Aac · Papuguinho
Params155M
Context2K
Q4_K_M0.1 GB
Embedding
GR
granite 3.1 2b instruct
Granite · QuantFactory
Params2.63B
Context128K
Q4_K_M1.6 GB
GGUF
DE
deepseek-coder-1.3b-instruct
DeepSeek · duyntnet
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
MI
MiniCPM
MiniCPM · runfuture
Params2.72B
Context2K
Smallest1.7 GB
GGUF
TI
TinySolar-248m-4k-py
Tinysolar · RichardErkhov
Params248M
Context32K
Q4_K_M0.2 GB
GGUF
FI
FireRedASR2-AED
Fireredasr · cstr
Params1.18B
Context—
Smallest1.0 GB
GGUF
MA
Mamba2 130m Hf
Mamba · rpatel622
Params168M
Context1024K
Smallest0.2 GB
GGUF
QW
Qwen3-TTS-12Hz-0.6B-CustomVoice
Qwen · sakasegawa
Params1.02B
Context—
Smallest0.8 GB
GGUF
KI
Kimodo-G1-SEED-v1
Kimodo · LocalAI-io
Params284M
Context—
Smallest1.1 GB
GGUF
QW
qwen3 asr 1.7b ja anime
Qwen · cstr
Params2.35B
Context—
Smallest1.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · BafS
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Other sizes

Keep browsing