Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama TinyLlama 1.1B Intermediate Step 1431k 3T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama R1 LIMO
Tinyllama · mradermacher
Params1.1B
Context8K
Q4_K_M0.7 GB
Reasoning
TI
TinyLlama 1.1B DPO HumanLike
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Tele It
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v1
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Intermediate Step 1195k Token 2.5T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama TinyLlama 1.1B Chat v1.0
Tinyllama · ProffiTroll
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Chat v0.4
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
Tinyllama-1.5B-Cinder-Test-2
Tinyllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · hieupt
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B chat ties v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate 1.5T PTBR Instruct v2
Tinyllama · afrideva
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tmd-rahul/tinyllama-chatbot-merged-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Email DPO Synthetic
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
philimon/tinyllama-docker-v1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
macabdul9/TinyLlama-1.1B-HuBERT-discrete-tokens-LibriSpeechASR
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat Math v1.0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
py007_tinyllama-1.1b-chat-v0.3
Tinyllama · iandennismiller
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
TinyLlama_1.1b_test
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama coder sql en v0.1
Tinyllama · yuiseki
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama 1.0 1.1b chat
Tinyllama · lm-kit
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1bee
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama medical
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama 15M
Tinyllama · mradermacher
Params15M
Context256
Q4_K_M0.0 GB
GGUF
TI
Tinyllama-616M-Cinder
Tinyllama · RichardErkhov
Params616M
Context2K
Q4_K_M0.4 GB
GGUF
TI
Tinyllama Pe Edition
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLLama-4x1.1B-MoE
Tinyllama · RichardErkhov
Params3.38B
Context2K
Q4_K_M2.0 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding

Keep browsing