Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
Deathsquad10/TinyLlama-repeat
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama NoPE 1.1B
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 3MPER0RR Obliterated
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
philimon/TinyLlama-gsm8k-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0.Q4 k
Tinyllama · Boltuzamaki
Params1.1B
Context2K
Smallest0.7 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-1epch-airoboros3.1-1k-instruct-V1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Arabic Mental v4
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-1.1b-sum-sft-full_old
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · nitsuai
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
yuiseki/tinyllama-it-wikipedia-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-orca-v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-1.5T-OpenOrca-Alpha
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
gguf Tinyllama 616M Cinder
Tinyllama · Felladrin
Params616M
Context2K
Q4_K_M0.4 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 480k 1T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
gguf TinyLlama 1.1B 1T OpenOrca
Tinyllama · Felladrin
Params1.1B
Context2K
Smallest0.5 GB
GGUF
TI
tinyllama-1b-softmax-sft-full
Tinyllama · RichardErkhov
Params1.34B
Context2K
Q4_K_M0.8 GB
GGUF
TI
TinyLlama Sakha Instruct
Tinyllama · mradermacher
Params1.16B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_s02_i
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Hoyeon/TinyLlama-1.1B-scratch
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-coder-py-v11
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
tinyllama-coder-py-4bit-v9
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
TinyLlama-1.1B-Chat-v1.0
Tinyllama · larenspear
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-730M-test
Tinyllama · RichardErkhov
Params748M
Context2K
Q4_K_M0.5 GB
GGUF
TI
ZainabF/tinyllama-colorist-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v8
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Fine Tuned
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Bnb 4bit
Tinyllama · MB20261
Params1.1B
Context8K
Q4_K_M0.7 GB
GGUF

Keep browsing