Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama text2SQL v0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B step 720K 1510B
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
TI
ambrosfitz/tinyllama-history-chat_v0.2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
zioBoe/tinyllama-emo-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
SchubergPhilis/TinyLlama-1.1B-Chat-v0.6-ENG
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat SFT Alpaca DPO Ultrafeedback
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama ironman v2
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · ArRENCEAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
NilanE/tinyllama-en_ja-translation-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-3epochs-oasst1-top1-instruct-V1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama r1
Tinyllama · mradermacher
Params1.1B
Context8K
Q4_K_M0.7 GB
Reasoning
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_3_def
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Mental Chat V1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Colorist v1 Merged
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama ja wikipedia qa 1.5T v0.1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-OpenHermes-2.5-Chat-v0.1-sft
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
TI
TinyLlama 3T Cinder v1.3
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TiamaPY-v33
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama-1.1B-2.5T-chat
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-748M-Reason-With-Cinder-Test-2
Tinyllama · RichardErkhov
Params748M
Context2K
Q4_K_M0.5 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 1195k Token 2.5T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama 15M
Tinyllama · RichardErkhov
Params15M
Context256
Q4_K_M0.0 GB
GGUF
TI
TinyLlama text2SQL indentacao
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
elijahww/TinyLlama-1.1B-merged
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 Q2 K
Tinyllama · reach-vb
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Ninjacart/tinyllama-sms_parsert-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-955k-token-2T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
hi tinylama gguf 16bit
Tinyllama · devlocalhost
Params1.1B
Context4K
Smallest2.2 GB
GGUF

Keep browsing