Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama 1.1B intermediate step 715k 1.5T airoboros 3.1 V2
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 3T Cinder v1.2 i1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 715k 1.5T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Intermediate Step 1195k Token 2.5T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B 2T lr 2e 4 3ep dolly 15k instruct v1
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama python
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
Tinyllama 1.1b
Tinyllama · ElementMerc
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama Evol Instruct
Tinyllama · theprint
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6 x8 MoE
Tinyllama · tsunemoto
Params6.43B
Context2K
Q4_K_M3.6 GB
GGUF
TI
Tinyllama 1.1b Abliterated
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
ModelCloud Tinyllama 15M Stories
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Intermediate Step 955k Token 2T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama 1.1B 1T OpenOrca
Tinyllama · Aryanne
Params1.1B
Context2K
Smallest0.5 GB
Coding
TI
Tinyllama Roleplay
Tinyllama · mradermacher
Params1.1B
Context4K
Q4_K_M0.7 GB
Roleplay
TI
TinyLlama 1.1B Intermediate Step 1431k 3T
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama 1.3B Cinder Reason Test 2
Tinyllama · Josephgflowers
Params1.28B
Context4K
Smallest1.4 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 1431k 3T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 3T 1.1bee
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
RedHatAI/TinyLlama-1.1B-Chat-v1.0-pruned2.4
Tinyllama · tinyopsec
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · 49Simoney
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama 1.1b Uncensored
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLLama NSFW Chatbot
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-2.5T-chat-and-function-calling
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
TI
Oprius 1.1B
Tinyllama · tinyopsec
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama con creative writing v0.2
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Telugu-Romanization-v0-Base
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Jenna-Unensored-GGUF-16-v2
Tinyllama · V3N0M
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
TinyLlama-1.1B-Chat-v0.5
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Tele It
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing