Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
tinyllama-coder-py-4bit-v6
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Smallest1.2 GB
Coding
TI
gguf TINYLLAMA dqg v1a q4 k m
Tinyllama · cvzion
Params1.1B
Context4K
Q4_K_M0.7 GB
Tool use
TI
bubblesort llm
Tinyllama · adiiiii13
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
gguf tinyllama dqg v03032024
Tinyllama · cvzion
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-alpaca-ruralcare-v3
Tinyllama · Crimsoin
Params1.1B
Context4K
Smallest2.2 GB
GGUF
TI
TinyLlama_v1.1_math_code
Tinyllama · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
geometry function finetuned tinyllama
Tinyllama · aryan27
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
tinyllama medquad
Tinyllama · Sanjarbek1024
Params1.1B
Context2K
Smallest0.6 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 1431k 3T
Tinyllama · JCLin000
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
Tinyllama 15M
Tinyllama · tensorblock
Params15M
Context256
Smallest0.0 GB
GGUF
TI
tinyllama merged
Tinyllama · Laibaaaaa
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat Sw
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Buddytalk
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama2.0 Test1
Tinyllama · RichardErkhov
Params1.49B
Context4K
Q4_K_M0.9 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 GGUF
Tinyllama · shamil010
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
gguf tinyllama dqg 03052024 v1q4 k m
Tinyllama · cvzion
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
gguf TINYLLAMA dqg v4a q8 0
Tinyllama · cvzion
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
tinyllama
Tinyllama · 0b10headedcalf
Params1.24B
Context128K
Smallest0.6 GB
Tool use
TI
TinyLlama-1.1B-Chat-v1.0
Tinyllama · haihui
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · dogma-black
Params1.1B
Context2K
Smallest0.5 GB
Coding
TI
TinyLlama-1.1B-intermediate-step-1431k-3T
Tinyllama · zlyva
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama Chat Bnb 4bit
Tinyllama · vislupus
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama
Tinyllama · ALI-B
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinyllama gsm8k 2 THIRD 3epochs Q8 0
Tinyllama · zeref713
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
gguf TINYLLAMA dqg v5a q8 0
Tinyllama · cvzion
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
Tinyllama German
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 1431k 3T
Tinyllama · kusimari
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · Rupe7727
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · mehmetcanbudak
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF

Keep browsing