Tiny GGUF models
62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.
QW
tiny agent
Qwen · hkblockchaintechnology
Params752M
Context40K
Q4_K_M0.5 GB
QW
Qwen1.5 0.5B
Qwen · mradermacher
Params620M
Context32K
Q4_K_M0.4 GB
QW
CHOCO BRAIN 0.8B v0.1
Qwen · hwihwalab
Params752M
Context256K
Smallest0.8 GB
SU
SummLlama3.2 3B
Summllama · dil99x
Params3.21B
Context128K
Smallest2.3 GB
HE
HelpingAI Lite
Helpingai · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
BG
bge m3
BGE · bbvch-ai
Params567M
Context8K
Q4_K_M0.4 GB
AE
Aevum 0.6B Finetuned
Aevum · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
DU
Dut Recipe Generator
Dut · mradermacher
Params559M
Context1K
Q4_K_M0.4 GB
MI
Mistralai Shieldstral 1.0 3B
Mistral · noctrex
Params3.43B
Context256K
Q4_K_M2.1 GB
RW
Rwkv7 G1 1.5b Instruct Preview
Rwkv · mzwing
Params1.53B
Context1024K
Q4_K_M1.0 GB
QW
Qwen3.6 27B DSpark
Qwen · satgeze
Params1.86B
Context256K
Smallest3.7 GB
IN
InstructLM 500M
Instructlm · QuantFactory
Params568M
Context2K
Q4_K_M0.4 GB
DE
Decider 0.8b
Decider · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
QW
Qwen3 Shining Lucy CODER 2.4B Mix2
Qwen · mradermacher
Params2.43B
Context40K
Q4_K_M1.5 GB
TI
TinyLlama_v1.1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
BI
bielik 1.5b v3 matura history sft2
Bielik · SlayerLab
Params1.6B
Context8K
Q4_K_M1.0 GB
XL
xLAM 2 3b Fc R
Xlam · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
HE
heretic_HelpingAI 3B Coder
Heretic · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
BH
BharatGPT 3B Indic i1
Bharatgpt · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
AI
Aira-2-1B5
Aira · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
TR
TranslatePsy AfriSLM 0.8B
Translatepsy · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
QW
Sage 3b 4bit NSFW RP
Qwen · sinhal
Params3.09B
Context32K
Smallest1.9 GB
LF
LFM2.5 2.6B heretic
Lfm · saidutta69
Params2.7B
Context128K
Q4_K_M1.7 GB
QW
kitty bash llm
Qwen · sahellx
Params494M
Context32K
Q4_K_M0.4 GB
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
AL
all-MiniLM-L12-v2
All · leliuga
Params33M
Context512
Q4_K_M0.0 GB
GE
Gemma 2b Uncensored v1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
QW
stream 1 mini
Qwen · whisperstream
Params752M
Context32K
Q4_K_M0.5 GB
TT
fastpitch en
Tts · cstr
Params60M
Context—
Smallest0.1 GB
CH
ChindaMT 0.8B
Chindamt · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB