Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama_v1.1
Tinyllama · itlwas
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
elysa beta
Tinyllama · sbawa
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama-1.1b-chat-dpo-full
Tinyllama · israellaguan
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
tinyllama coedit
Tinyllama · gnokit
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinyllama 1.1B alpaca 2k lora F16
Tinyllama · Dips-1991
Params25M
Context—
Smallest0.1 GB
GGUF
TI
TinyLlama 1.1B Chat v0.7 ENG
Tinyllama · SchubergPhilis
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
TinyLlama schemaLinking dict
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
tinyllama history chat
Tinyllama · ambrosfitz
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
ent val personal 4bit
Tinyllama · omniquad
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B 1.5T OpenOrca Alpha
Tinyllama · confusion8760
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0 2bit wikitext
Tinyllama · imi2
Params1.1B
Context2K
Smallest0.3 GB
GGUF
TI
TiamaPY-v30
Tinyllama · Ramikan-BR
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tinyllama_finetuned40x3
Tinyllama · madushan99
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-1.1B-Chat-v0.6-x8-MoE
Tinyllama · EnverLee
Params6.43B
Context2K
Smallest6.8 GB
GGUF
TI
tinyllama 1.1b rag cv
Tinyllama · HrudakovSerhii
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · zeeshanali01
Params1.1B
Context8K
Smallest0.0 GB
GGUF
TI
challange3.1 v2
Tinyllama · schur11
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
tinyllama emo v1
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Bnb 4bit
Tinyllama · jxxqtech
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
raikai
Tinyllama · Raidone
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · AriDiscoSquid
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
tinyllama chatbot merged v2
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama 1.5B Cinder New Test 1 with
Tinyllama · Josephgflowers
Params1.54B
Context2K
Smallest3.1 GB
GGUF
TI
Tinyllama-sp
Tinyllama · SoloBSD
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v0.3
Tinyllama · nezubn
Params1.1B
Context4K
Smallest0.0 GB
GGUF
TI
MyBloggerV0.16
Tinyllama · andrewatef
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
ggml model Q4 K M
Tinyllama · pavel-tolstyko
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · lehungquangminh
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
se model q8 0
Tinyllama · egges2
Params1.1B
Context4K
Smallest1.2 GB
GGUF
TI
tinyllama-nerd-gguf
Tinyllama · ar08
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF

Keep browsing