Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
tinyllama therapy bot v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama-1.5B-Cinder-Test-4
Tinyllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
TI
Tinyllama 1.1b Rus Mix Merged
Tinyllama · wexyyyyyy
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · abcsnoobai
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
jawadmohmmad/tinyllama-colorist-v2
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Prajna1999/tinyllama-prajna
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
wamegabe/tinyllama-wame-4bit-curi
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
TI
Tinyllama Linux Command
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B step 480K 1007B
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v11
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
TI
xw17/TinyLlama-1.1B-Chat-v1.0_finetuned_s01_3
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-1T-OpenOrca
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLLama v0
Tinyllama · mradermacher
Params5M
Context2K
Q4_K_M0.0 GB
GGUF
TI
tinyllama claude 8bit
Tinyllama · Cossale
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama coder python ja wikipedia amenokaku v0.1
Tinyllama · yuiseki
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
healthcare ai q4 k m
Tinyllama · moriire
Params1.1B
Context4K
Q4_K_M0.4 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · tensorblock
Params1.86B
Context2K
Smallest0.7 GB
GGUF
TI
Josephgflowers Tinyllama 616M Cinder
Tinyllama · tensorblock
Params616M
Context2K
Smallest0.3 GB
GGUF
TI
tinyllama hate speech detector v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
140M TinyLLama Mini Cinder With GGUF
Tinyllama · RichardErkhov
Params138M
Context2K
Q4_K_M0.1 GB
GGUF
TI
TinyLlama 1.1B step 50K 105b
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
tinyllama gsm8k 2 THIRD 3epochs with EOS q4 k m
Tinyllama · zeref713
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
hcl tinyllama 1.1b javascript lotuscript
Tinyllama · arvnoodle
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.1
Tinyllama · Trelis
Params1.1B
Context2K
Smallest0.7 GB
Coding
TI
Tinyllama 1.3B Cinder Reason Test
Tinyllama · Josephgflowers
Params1.28B
Context4K
Smallest1.4 GB
GGUF
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF

Keep browsing