Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · NightShade9x9
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
tinyllama-ft-en-es-rag-gguf-q8_0
Tinyllama · mrm8488
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
tinyllama 1.1b chat v1.0 Q4 0 4 4
Tinyllama · flyfishstudio
Params1.1B
Context2K
Smallest0.6 GB
GGUF
TI
se model q4 k m
Tinyllama · egges2
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
twitch chat tinyllama 1.1b
Tinyllama · Catmanjoe
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1b HumanLike DPO
Tinyllama · Novaciano
Params1.1B
Context2K
Smallest0.7 GB
GGUF
TI
tinyllama 1.1b rag cv v1 F16
Tinyllama · HrudakovSerhii
Params13M
Context—
Smallest0.0 GB
GGUF
TI
tinyllama 1.1b layla v1
Tinyllama · confusion8760
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v1.0-german
Tinyllama · Fadikkop
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-intermediate-step-1431k-3T
Tinyllama · zlyva
Params1.1B
Context2K
Smallest0.8 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · perrotti
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
TinyLlama-1.1B-Chat-v1.0-x2-MoE
Tinyllama · RichardErkhov
Params1.86B
Context2K
Q4_K_M1.1 GB
GGUF
TI
Tinyllama 1.1b Layla v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
Tinyllama Chat Bnb 4bit Phl Style Gen Gguf
Tinyllama · peeache
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
gguf TINYLLAMA dqg v5a q4 k m
Tinyllama · cvzion
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
conversation model
Tinyllama · noweshere
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · leargaf
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama Ft codeAlpaca Adapter
Tinyllama · Dips-1991
Params25M
Context—
Smallest0.1 GB
GGUF
TI
testTinyLlama
Tinyllama · AnuragVohra
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Chat
Tinyllama · unclemusclez
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tinyllama colorist v0
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tinyllama trl
Tinyllama · arif-butt
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · ysn-rfd
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
tinyllama manual q4
Tinyllama · dppandeydevesh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama imrankhan
Tinyllama · MuhammadAhmadZia
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama_TinyLlama-1.1B-Chat-v1.0-sft-dpo
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama 1.1B FFT Distilled
Tinyllama · WhoTookMyAmogusNickname
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
Tinyllama Chatbot Merged v4
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing