Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama TinyLlama 1.1B Chat v0.3
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B optimized i1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-step-2T-lr-5-5ep-oasst1-top1-instruct-V1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama r1 i1
Tinyllama · mradermacher
Params1.1B
Context8K
Q4_K_M0.7 GB
Reasoning
TI
TinyLlama 1.1B Chat v1.0 Heretic
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B intermediate step 715k 1.5T lr 5 4epochs oasst1 top1 instruct V1
Tinyllama · afrideva
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama Cinder Agent v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 q4 k m
Tinyllama · reach-vb
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Alpaca QLoRA
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-1195k-token-2.5T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · pbatra
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama text2SQL alias indentacao
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Tele
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama Cinder Agent v1 i1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v0.2
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama 15M
Tinyllama · mradermacher
Params15M
Context256
Q4_K_M0.0 GB
GGUF
TI
tinyllama alpaca cthulhu small
Tinyllama · theprint
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-1.1B-intermediate-step-715k-1.5T-dpo-lora-merged
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.5
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama_Alpaca_Sft_Sample
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama TinyLlama 1.1B intermediate step 1431k 3T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B 32k Instruct
Tinyllama · mradermacher
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama R1 LIMO i1
Tinyllama · mradermacher
Params1.1B
Context8K
Q4_K_M0.7 GB
Reasoning
TI
TinyLlama_v1.1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v1.0-function-calling
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
Tool use
TI
takano32/tinyllama-color-coder-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v0.2
Tinyllama · TinyLlama
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
TinyLlama-1.1B-intermediate-step-480k-1T
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing