Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
tinyllama-coder-py-v19
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Slerp v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama PY CODER 4bit lora 4k v8
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · player1537
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 Q4 K M
Tinyllama · pcuenq
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama-bengali-gguf
Tinyllama · ar08
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-1431k-3T
Tinyllama · v8karlo
Params1.1B
Context2K
Smallest0.8 GB
Coding
TI
tinyllama-coder-py-v17
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0 imatrix
Tinyllama · liodon-ai
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
exfolio test model
Tinyllama · esass10
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
Maykeye TinyLLama v0
Tinyllama · tensorblock
Params5M
Context2K
Smallest0.0 GB
GGUF
TI
tinyllama coder python ja amenokaku v0.1
Tinyllama · yuiseki
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
stalkiq ios app generator
Tinyllama · stalkiq
Params1.1B
Context2K
Smallest2.2 GB
Coding
TI
tinyllama-indonesia
Tinyllama · biznetgio
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B 32k Instruct
Tinyllama · tensorblock
Params1.1B
Context32K
Smallest0.4 GB
GGUF
TI
Harness_Model
Tinyllama · algoscienceacademy
Params1.1B
Context2K
Smallest2.2 GB
Reasoning
TI
Tinyllama Chat v0.4 OpenOrca
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Alestin/tinyllama-outline-generator
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-chat-bnb-4bit
Tinyllama · Diluzx
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama-1.5B-Cinder-Test-1
Tinyllama · RichardErkhov
Params1.5B
Context2K
Q4_K_M0.9 GB
GGUF
TI
TinyLlama TinyLlama 1.1B Intermediate Step 480k 1T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama 1.1B Chat v0.2
Tinyllama · Trelis
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama fr aya 1.5T v0.1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B intermediate step 240k 503b
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama Friendly Psychotherapist v1.5
Tinyllama · mradermacher
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-1.1b-layla-v4
Tinyllama · l3utterfly
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama 616M Cinder DPO With
Tinyllama · Josephgflowers
Params616M
Context4K
Smallest1.2 GB
GGUF
TI
Tinyllama Chat v0.4 OpenOrca
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
yuiseki/tinyllama-zh-wikipedia-aya-1.5T-v0.1
Tinyllama · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Python v0.1
Tinyllama · SinpxAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing