Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama-1.1b-karasu-merged
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1bee i1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
biblegpt
Tinyllama · oliverbob
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama.TinyLlama 1.1B Chat v1.0
Tinyllama · DevQuasar-9
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
AliMaatouk TinyLlama 1.1B Tele
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
TinyLlama 3T Cinder v1.2
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
140M TinyLLama Mini Cinder With
Tinyllama · Josephgflowers
Params138M
Context2K
Smallest0.3 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-Cinder-1.3B-Test.2
Tinyllama · RichardErkhov
Params1.28B
Context2K
Q4_K_M0.8 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLLama v0
Tinyllama · afrideva
Params5M
Context2K
Q4_K_M0.0 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-1.1b-sum-sft-full
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-coder-py-v16
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
ambrosfitz/tinyllama-history-chat_v0.2.1ps
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama_v1.1_chinese
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TiamaPY-v31
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
yuiseki/tinyllama-es-wikipedia-aya-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate step 1195k token 2.5T
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
R1pathak/TinyLlama_v1.1_float16_0.0
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B OpenHermes 2.5 Chat v0.1 sft
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
TI
TinyLlama 1.1B Tarot Chat v1.0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TiamaPY-v32
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama 1.1B Chat v1.0 OBLITERATED
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
50stars/TinyLlama-psy-dpo
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 3T Cinder v1.3
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Chat v1.0
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
wamegabe/tinyllama-wame-4bit-curi2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
TI
tinyllama-coder-py-v15
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding

Keep browsing