Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
tinyllama-coder-py-4bit-v8
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
yuiseki/tinyllama-si-wikipedia-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-1.1b-layla-v4
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 Heretic
Tinyllama · ChiKoi7
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Intermediate Step 480k 1T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Narednra/tinyllama2_updated
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLLama v0
Tinyllama · aladar
Params5M
Context2K
Smallest0.0 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B chat dare v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Abliterated
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
LukAss8/tinyllama-PT-v0
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama Psychotherapist
Tinyllama · mradermacher
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama-320M-Cinder-v1
Tinyllama · RichardErkhov
Params340M
Context2K
Q4_K_M0.2 GB
GGUF
TI
sandeep1401/tinyllama_finetuned
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Instruct v1.0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 3T Cinder v1.3
Tinyllama · Josephgflowers
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v1.0-reasoning-v2
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Reasoning
TI
Tinyllama-Cinder-1.3B-Reason-Test.2
Tinyllama · RichardErkhov
Params1.28B
Context2K
Q4_K_M0.8 GB
GGUF
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_4
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v3
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TiamaPY-v34
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-coder-py-v21
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
tinyllama-coder-py-v18
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · lovatophoenix2
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v6
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
yuiseki/tinyllama-ja-wikipedia-scp-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing