Tiny GGUF models

150 GGUF models in the Tiny family, quantized by 51 uploaders. Sizes run from 3M to 3.88B parameters. The longest trained context is 488K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
tiny random gpt neox
Tiny · tensorblock
Params42M
Context2K
Smallest0.0 GB
GGUF
TI
tiny random BloomForCausalLM
Tiny · aladar
Params—
Context7
Smallest0.0 GB
GGUF
TI
Tiny Purr 350M
Tiny · purrgpt-community
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
TI
Tiny Aya Earth
Tiny · keisuke-miyako
Params3.35B
Context488K
Smallest3.6 GB
GGUF
TI
tiny emotion
Tiny · the-robot-ai
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
Tiny Urvashi v1 Tinyllama
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tiny Aya Global
Tiny · keisuke-miyako
Params3.35B
Context488K
Smallest3.6 GB
GGUF
TI
tiny gguf scan
Tiny · gopinama
Params—
Context2K
Smallest0.0 GB
GGUF
TI
TinyTesticle DPO 1B
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
Tiny slerp
Tiny · mradermacher
Params91M
Context2K
Q4_K_M0.1 GB
GGUF
TI
Tiny Random Stablelm 2
Tiny · RichardErkhov
Params127M
Context4K
Q4_K_M0.1 GB
GGUF
TI
Tiny DarkLlama Chat Q5 K M
Tiny · mrcuddle
Params1.1B
Context2K
Smallest0.8 GB
Roleplay
TI
tiny summary v2 Q8 0
Tiny · echos-keeper
Params61M
Context512
Smallest0.1 GB
GGUF
TI
tiny herbalism v1
Tiny · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyDarkLlama DPO RESIDENT EVIL SPIN
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
Roleplay
TI
Tiny Xctopus Model
Tiny · mradermacher
Params82M
Context1K
Q4_K_M0.1 GB
GGUF
TI
Tiny Gaucho 1.1b
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
uta sensei tiny aya
Tiny · mclpio
Params3.35B
Context8K
Q4_K_M2.1 GB
GGUF
TI
Stabilityai Tiny Random Stablelm 2
Tiny · tensorblock
Params127M
Context4K
Smallest0.1 GB
GGUF
TI
Tiny LLM TinyStories PyTorch
Tiny · CodeFlame
Params13M
Context1K
Smallest0.0 GB
GGUF
TI
tiny random orion
Tiny · tensorblock
Params94M
Context4K
Smallest0.1 GB
GGUF
TI
Tiny Slm Storyteller v1
Tiny · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
TI
Tiny Aya Fire
Tiny · keisuke-miyako
Params3.35B
Context488K
Smallest3.6 GB
GGUF
TI
Tiny LLM TinyStories PyTorch
Tiny · CodeFlame
Params13M
Context1K
Q4_K_M0.0 GB
GGUF
TI
Tiny_T5_De
Tiny · philipp-zettl
Params9M
Context512
Smallest0.0 GB
GGUF
TI
Tiny Random Orion
Tiny · mradermacher
Params22M
Context256
Q4_K_M0.0 GB
GGUF
TI
Tiny LLM
Tiny · adoaskdaoskd
Params13M
Context1K
Smallest0.0 GB
GGUF
TI
Tiny RAG
Tiny · TroyDoesAI
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
agripadi tiny aya earth q4 k m
Tiny · Alabi-Ayobami
Params3.35B
Context8K
Q4_K_M2.1 GB
GGUF
TI
Tiny LLM
Tiny · sinistera
Params13M
Context1K
Smallest0.0 GB
GGUF

Keep browsing