Tiny GGUF models

62726 GGUF models with 3B parameters or fewer. Sizes run from 1M to 3.5B parameters. The longest trained context is 795898K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
tiny agent
Qwen · hkblockchaintechnology
Params752M
Context40K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen1.5 0.5B
Qwen · mradermacher
Params620M
Context32K
Q4_K_M0.4 GB
GGUF
QW
CHOCO BRAIN 0.8B v0.1
Qwen · hwihwalab
Params752M
Context256K
Smallest0.8 GB
ReasoningTool use
SU
SummLlama3.2 3B
Summllama · dil99x
Params3.21B
Context128K
Smallest2.3 GB
Tool use
HE
HelpingAI Lite
Helpingai · QuantFactory
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
BG
bge m3
BGE · bbvch-ai
Params567M
Context8K
Q4_K_M0.4 GB
Embedding
AE
Aevum 0.6B Finetuned
Aevum · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
CodingReasoningTool use
DU
Dut Recipe Generator
Dut · mradermacher
Params559M
Context1K
Q4_K_M0.4 GB
GGUF
MI
Mistralai Shieldstral 1.0 3B
Mistral · noctrex
Params3.43B
Context256K
Q4_K_M2.1 GB
Vision
RW
Rwkv7 G1 1.5b Instruct Preview
Rwkv · mzwing
Params1.53B
Context1024K
Q4_K_M1.0 GB
GGUF
QW
Qwen3.6 27B DSpark
Qwen · satgeze
Params1.86B
Context256K
Smallest3.7 GB
ReasoningTool use
IN
InstructLM 500M
Instructlm · QuantFactory
Params568M
Context2K
Q4_K_M0.4 GB
GGUF
DE
Decider 0.8b
Decider · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
QW
Qwen3 Shining Lucy CODER 2.4B Mix2
Qwen · mradermacher
Params2.43B
Context40K
Q4_K_M1.5 GB
CodingReasoningTool use
TI
TinyLlama_v1.1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
BI
bielik 1.5b v3 matura history sft2
Bielik · SlayerLab
Params1.6B
Context8K
Q4_K_M1.0 GB
GGUF
XL
xLAM 2 3b Fc R
Xlam · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
HE
heretic_HelpingAI 3B Coder
Heretic · mradermacher
Params3.48B
Context125K
Q4_K_M2.1 GB
Coding
BH
BharatGPT 3B Indic i1
Bharatgpt · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
GGUF
AI
Aira-2-1B5
Aira · mradermacher
Params1.64B
Context1K
Q4_K_M1.2 GB
GGUF
TR
TranslatePsy AfriSLM 0.8B
Translatepsy · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
QW
Sage 3b 4bit NSFW RP
Qwen · sinhal
Params3.09B
Context32K
Smallest1.9 GB
RoleplayTool use
LF
LFM2.5 2.6B heretic
Lfm · saidutta69
Params2.7B
Context128K
Q4_K_M1.7 GB
ReasoningTool use
QW
kitty bash llm
Qwen · sahellx
Params494M
Context32K
Q4_K_M0.4 GB
CodingTool use
GR
Granite Vision 3.3 2B BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
AL
all-MiniLM-L12-v2
All · leliuga
Params33M
Context512
Q4_K_M0.0 GB
CodingEmbedding
GE
Gemma 2b Uncensored v1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
QW
stream 1 mini
Qwen · whisperstream
Params752M
Context32K
Q4_K_M0.5 GB
GGUF
TT
fastpitch en
Tts · cstr
Params60M
Context—
Smallest0.1 GB
GGUF
CH
ChindaMT 0.8B
Chindamt · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision

Other sizes

Keep browsing