Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama 1.1B ProXMath
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
cisco inam tiny
Tinyllama · ndavidson
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
Haary/TinyLlama-1.1B-indo-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama Remix
Tinyllama · Deathsquad10
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
tinyllama-1.1b-layla-v4
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama-1.5B-Cinder-Test-3
Tinyllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
TI
tinyllama-coder-py-4bit-v7
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
Tinyllama 15M Stories
Tinyllama · lhasting
Params15M
Context256
Smallest0.0 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 715k 1.5T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama claude 16bit
Tinyllama · Cossale
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
tinyllama-coder-py-4bit-v3
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Smallest1.2 GB
Coding
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · mengtiandu
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama2.0 Test2
Tinyllama · RichardErkhov
Params1.49B
Context4K
Q4_K_M0.9 GB
GGUF
TI
niryuu/tinyllama-task003_mctaco_question_generation_event_duration-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate step 480k 1T
Tinyllama · Trelis
Params1.1B
Context2K
Smallest0.0 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
09z/tinyllama-cleantech-finetune
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.4 ENG
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B OpenHermes 2.5 Chat v0.1 sft
Tinyllama · abhinand
Params1.1B
Context2K
Smallest1.2 GB
Tool use
TI
maneln/1.1b-tinyllama
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama2 jp 122M FlashAttention2
Tinyllama · mradermacher
Params122M
Context2K
Q4_K_M0.1 GB
GGUF
TI
Tinyllama 1.3B Cinder Reason Test 2
Tinyllama · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
GGUF
TI
TinyLlama-1.1bee
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B indo v1
Tinyllama · ukung
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
healthcare ai q8 0
Tinyllama · moriire
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 1431k 3T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama-1.1B-indo-v1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama 320M Cinder v1
Tinyllama · mradermacher
Params340M
Context2K
Q4_K_M0.2 GB
GGUF
TI
tinyllama chatbot merged v3
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing