Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama-120M-scratch
Tinyllama · RichardErkhov
Params121M
Context2K
Q4_K_M0.1 GB
GGUF
TI
TinyLlama 3MPER0RR Abliterated
Tinyllama · 3MPER0RR
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
Tinyllama
Tinyllama · RichardErkhov
Params1.2B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B alpaca chat v1.5
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Jenna-Uncensored-GGUF-v02
Tinyllama · V3N0M
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · jan-hq
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-15M
Tinyllama · RichardErkhov
Params15M
Context256
Q4_K_M0.0 GB
GGUF
TI
Tinyllama
Tinyllama · israellaguan
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
Nickypro Tinyllama 15M
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
GGUF
TI
TinyLlama 1.1B Tele
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Home TinyLlama 1.1B HomeAssist
Tinyllama · premrajreddy
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-gguf-Unsloth
Tinyllama · Haary
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-15M-stories
Tinyllama · RichardErkhov
Params15M
Context256
Q4_K_M0.0 GB
GGUF
TI
tinyllama-coder-py-v13
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
whynlp/tinyllama-zh
Tinyllama · featherless-ai-quants
Params1.24B
Context2K
Q4_K_M0.8 GB
GGUF
TI
Tinyllama Zh Ft 2.5T 90b
Tinyllama · mradermacher
Params1.24B
Context2K
Q4_K_M0.8 GB
GGUF
TI
Tinyllama-1.5B-Cinder-Test-5
Tinyllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
TI
TinyLlama v1.1 Cinders World
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Jenna-Uncensored-GGUF-q4-v02
Tinyllama · V3N0M
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama2 jp 122M
Tinyllama · mradermacher
Params122M
Context2K
Q4_K_M0.1 GB
GGUF
TI
sphere 047 m4 overnight
Tinyllama · nativemind
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B 32k
Tinyllama · andrijdavid
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-DavidAttenborough
Tinyllama · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B PythonSkill
Tinyllama · ukung
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama Fitness Instructor
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
Tinyllama 1.3B Cinder Reason Test 2
Tinyllama · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
TI
TinyLlama-1.1B-Remix-V.2
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 GGUF LAPTOP
Tinyllama · ar08
Params1.1B
Context2K
Smallest0.4 GB
GGUF

Keep browsing