Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
unsloth tinyllama q4km
Tinyllama · richie-ghost
Params1.1B
Context4K
Q4_K_M0.1 GB
GGUF
TI
TinnyLlamaGambling
Tinyllama · galanviorel
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · ysn-rfd
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
TinyLlama 1.1B Intermediate Step 715k 1.5T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
FinBot TinyLLama LoRA GGUF q4km
Tinyllama · NavyaAI
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama-moe4
Tinyllama · israellaguan
Params1.86B
Context2K
Smallest2.0 GB
GGUF
TI
TinyLlama Unsloth Guess Country
Tinyllama · vitorgamer58
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v0.6-x8-MoE
Tinyllama · EnverLee
Params6.43B
Context2K
Q4_K_M3.9 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 Q4 K M
Tinyllama · victor
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · darrenrourkeuk
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · archaeus06
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
TinyLlama_v1.1_math_code
Tinyllama · israellaguan
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
gguf sharded TinyLlama 1.1B 1T OpenOrca
Tinyllama · Felladrin
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
gguf tinyllama dqg 03052024 v1q8 0
Tinyllama · cvzion
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · nitinrathi
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama Guanaco
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 715k 1.5T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
Tinyllama2.0 Test3
Tinyllama · RichardErkhov
Params1.49B
Context4K
Q4_K_M0.9 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 Q4 K M
Tinyllama · lefromage
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · WTNLXTBL
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama1b_12k
Tinyllama · cc8055
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama Project gguf q8
Tinyllama · DavArm
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Chat
Tinyllama · QuantLLM
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama tinyLlama intermediate checkpoints
Tinyllama · tensorblock
Params7B
Context2K
Smallest0.0 GB
Coding
TI
FeatBot_6 GGUF
Tinyllama · dhruvsangani
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-gguf-q5
Tinyllama · abdymazhit
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
tinyllama alpaca q4
Tinyllama · Trisert
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
dre_tiny_norm_150_gguf
Tinyllama · empgces
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · remon-rakibul
Params1.1B
Context4K
Smallest0.0 GB
GGUF

Keep browsing