Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
tinyllama trl merged
Tinyllama · Maryam7711
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · SansarK
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
model save 16bit
Tinyllama · Nyoeb
Params1.1B
Context4K
Smallest2.2 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · mjschock
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
TinyLlama_v1.1
Tinyllama · unclemusclez
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Finetuned
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Python Coder
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama-mental_test1.1
Tinyllama · Abnmd
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-715k-1.5T-lr-5-2.2epochs-oasst1-top1-instruct-V1
Tinyllama · RichardErkhov
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · SkyNotion
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · irresistiblegrace97
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama indic sentiment gguf q8
Tinyllama · annavivin
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama-1.1B-Chat-v1.0
Tinyllama · NikFooBar
Params1.1B
Context2K
Smallest0.6 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · hieupt
Params1.1B
Context2K
Smallest0.7 GB
GGUF
TI
Tinyllama 110M
Tinyllama · mepha89
Params134M
Context1K
Smallest0.1 GB
GGUF
TI
unt tiny 1
Tinyllama · omar07ibrahim
Params1.1B
Context4K
Smallest2.2 GB
GGUF
TI
tinyllama 1.1b chat v1.0 Q4 0 4 8
Tinyllama · flyfishstudio
Params1.1B
Context2K
Smallest0.6 GB
GGUF
TI
tinyllama medical chat v1.3
Tinyllama · falan42
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
Flix BetaV2
Tinyllama · alfiandecker2
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
testing F16
Tinyllama · baiju007
Params1M
Context—
Smallest0.0 GB
GGUF
TI
tinyllama peft
Tinyllama · Hamzasajjad38
Params—
Context—
Smallest2.2 GB
GGUF
TI
tinyllama trl
Tinyllama · Laiba-07
Params—
Context—
Smallest2.2 GB
GGUF
TI
tinyllama merged
Tinyllama · Yasir-Bhatti
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
tinyllama bedtimestories
Tinyllama · shashank-indukuri
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
tinyllama medical chat v1.5
Tinyllama · falan42
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
coedit-tinyllama-chat-bnb-4bit
Tinyllama · letheviet
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinyllama custom sql recreate
Tinyllama · omniquad
Params1.35B
Context16K
Q4_K_M0.9 GB
GGUF
TI
Tinyllama QNA thesmartest 1.0
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · a-k-aAiMGoD
Params1.1B
Context2K
Smallest0.6 GB
GGUF

Keep browsing