Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
GE
gemma 3 1b it qat q4 0
Gemma · google
Params1B
Context32K
Smallest1.0 GB
QW
Qwen2.5 VL 32B Instruct
Qwen · samgreen
Params689M
Context125K
Q4_K_M19.9 GB
FI
FireRedLID
Fireredlid · cstr
Params887M
Context—
Smallest0.4 GB
DE
Deepseek R1 1.5B KomorAI
DeepSeek · KomorAI
Params1.78B
Context128K
Q4_K_M1.1 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Dirty Alice RP NSFW Llama 3.2 1B
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
WH
whisper small
Whisper · oxide-lab
Params242M
Context—
Smallest0.1 GB
LF
LFM2.5 230M heretic
Lfm · saidutta69
Params230M
Context125K
Q4_K_M0.2 GB
SP
Spark X2.6 1.7B
Spark · mradermacher
Params1.71B
Context1024K
Q4_K_M1.1 GB
HF
hft transformer
Hft · cstr
Params6M
Context—
Smallest0.0 GB
IR
irodori tts
Irodori · cstr
Params98M
Context—
Smallest0.0 GB
BI
Bielik 1.5B v3.0 Instruct
Bielik · second-state
Params1.6B
Context8K
Q4_K_M1.0 GB
LF
LFM2.5 350M Uncensored
Lfm · mradermacher
Params354M
Context125K
Q4_K_M0.2 GB
TR
TranslatePsy AfriSLM 0.8B Q8
Translatepsy · qvac
Params1.01B
Context256K
Smallest1.1 GB
SE
Wan2.1 T2V 1.3B SelfForcing VACE
Self · lym00
Params2.15B
Context—
Q4_K_M1.5 GB
CS
csm 1b
Csm · cstr
Params1.78B
Context—
Smallest1.4 GB
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · Ahmedcarpenter
Params1.86B
Context256K
Smallest0.9 GB
LL
llama3.2
Llama · cortexso
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Bitcoin News 1.7B
Qwen · shreyanshp
Params1.72B
Context40K
Smallest0.9 GB
KA
kartoffel orpheus 3b german natural
Kartoffel · cstr
Params3.3B
Context—
Smallest1.9 GB
LF
lfm2 audio 1.5b
Lfm · cstr
Params79M
Context—
Smallest0.2 GB
QW
Qwen3 1.7B
Qwen · QuantFactory
Params2.03B
Context40K
Q4_K_M1.3 GB
QW
Qwen3 ASR 1.7B JA Anime Galgame
Qwen · mradermacher
Params1.72B
Context64K
Q4_K_M1.1 GB
DA
danube3-500M
Danube · h2oai
Params514M
Context8K
Q4_K_M0.3 GB
LF
LFM2.5 VL 3B Absolute Heresy
Lfm · mradermacher
Params2.7B
Context125K
Q4_K_M1.7 GB
KR
KrynexAI 1.4
Krynexai · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
DE
DeepSeek V4.1 Flash 1017 UNCENSORED VQ
DeepSeek · Baekpica
Params485M
Context—
Smallest1.0 GB
QW
Qwen3 0.6B Tools
Qwen · iromu
Params596M
Context40K
Q4_K_M0.4 GB
QW
Qwen2.5 Math 1.5B Instruct
Qwen · RichardErkhov
Params1.54B
Context4K
Q4_K_M1.0 GB
SH
Sharp Coder V0.1
Sharp · Weinel-Ventures
Params161M
Context1K
Smallest0.3 GB