Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
tinyllama oasst15k Q4 K M
Tinyllama · vincent1337
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · Alvant
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama-moe-nord-chat
Tinyllama · israellaguan
Params3.38B
Context2K
Smallest3.6 GB
GGUF
TI
Tinyllama_Irac_Merged_Fp16
Tinyllama · pankajligade
Params1.1B
Context2K
Smallest0.7 GB
GGUF
TI
tinyllama review summary adapter v1 F16
Tinyllama · salchint
Params13M
Context—
Smallest0.0 GB
GGUF
TI
gparag tinyllama 1.1b finetuned
Tinyllama · gparag
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat model Q4 K M
Tinyllama · CFiLOSE
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v1.0
Tinyllama · ivar-vl
Params1.1B
Context2K
Q4_K_M0.7 GB
CodingVision
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · coralwiesner
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama indic sentiment
Tinyllama · annavivin
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama gsm8k 2 THIRD 3epochs with EOS Q8 0
Tinyllama · zeref713
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B Chat mobile int4
Tinyllama · dispatchAI
Params1.1B
Context2K
Smallest0.7 GB
GGUF
TI
tinyllama-coder-py-v23
Tinyllama · victorbur
Params1.1B
Context4K
Smallest1.2 GB
Coding
TI
model save 8bit Q8 0
Tinyllama · Nyoeb
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
TinyLlama_v1.1_chinese
Tinyllama · WTNLXTBL
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · lopezjhonf
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tinyllama bnb 4bit
Tinyllama · RaZehn
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
TI
test model
Tinyllama · Tinomar
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
tinyllama 1.1b
Tinyllama · kanwal-mehreen18
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
tinyllama 1k
Tinyllama · vincent1337
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama v1 fp16
Tinyllama · redoC-A2k
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · Frogbert
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama 1.1b chat local
Tinyllama · Epitech
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Remix V.2
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
Coding
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · stkrk
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
tinyllama dolly15k Q4 K M
Tinyllama · vincent1337
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v0.1
Tinyllama · NikFooBar
Params1.1B
Context2K
Smallest0.6 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · Nagadigital
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama_tinyllama-1.1b-chat-v1.0
Tinyllama · VedPrakash200
Params1.1B
Context2K
Smallest0.5 GB
GGUF
TI
tinyllama history chat v1.5 q8
Tinyllama · ambrosfitz
Params1.1B
Context2K
Smallest1.2 GB
GGUF

Keep browsing