Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
unt tiny 2
Tinyllama · omar07ibrahim
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinyllama56k
Tinyllama · mohan11111
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama_v2_gguf
Tinyllama · rajtest
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
Josephgflowers Tinyllama 320M Cinder v1
Tinyllama · tensorblock
Params340M
Context2K
Smallest0.1 GB
GGUF
TI
Tinyllama QNA thesmartest 1.0
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama medqa jp v1 Q4 K M
Tinyllama · surya-ravindra
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · Ansnaeem
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
tinyLlama
Tinyllama · MohamedSaeed-dev
Params1.1B
Context4K
Smallest2.2 GB
GGUF
TI
tinyllama 1.1b chat v1.0.Q4 K M
Tinyllama · Ishimwe-j
Params1.1B
Context2K
Smallest0.7 GB
GGUF
TI
tinyllama-sqllm-20240707_2
Tinyllama · Quangvm
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 1431k 3T
Tinyllama · JCLin000
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · cooonhwe
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama Chisato Merged
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · nitinrathi
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
TinyLlama_v1.1
Tinyllama · unclemusclez
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tinyllama tesla
Tinyllama · yashalhussain
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
tinyllama apaca
Tinyllama · kushaldulani
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B orca v1.0
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tinyllama 1.1b chat v1.0.Q4 K M
Tinyllama · NyxGleam
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama 1b v1.5
Tinyllama · shuaibbacker
Params1.24B
Context128K
Smallest1.3 GB
CodingTool use
TI
tinyllama_v1_gguf
Tinyllama · rajtest
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama_v1.1-ORPO
Tinyllama · sydneyfong
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-4epochs-oasst1-top1-instruct-V1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tinyllama8bit80k_new
Tinyllama · cc8055
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · awildergoose
Params1.1B
Context2K
Q4_K_M1.2 GB
GGUF
TI
Tinyllama
Tinyllama · Abhishekdhaka
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B python v0.1
Tinyllama · Daxstar
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
Tinyllama 1 q8 bit
Tinyllama · prabal123
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
Tinyllama 2 f32bit
Tinyllama · prabal123
Params1.1B
Context2K
Smallest4.4 GB
GGUF
TI
Tinyllama
Tinyllama · fisher046
Params1.1B
Context2K
Smallest2.2 GB
GGUF

Keep browsing