Tinyllama GGUF models

1128 GGUF models in the Tinyllama family, quantized by 406 uploaders. Sizes run from 1M to 8.03B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
TinyLlama-1.1B-Chat-v0.6
Tinyllama · skyxiaobaibai
Params1.1B
Context2K
Smallest0.6 GB
Coding
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · Shreyas0706
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
Tinyllama_32K
Tinyllama · RichardErkhov
Params1.1B
Context32K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama2.0 Test5
Tinyllama · RichardErkhov
Params1.49B
Context4K
Q4_K_M0.9 GB
GGUF
TI
tinyllama ak Finetune
Tinyllama · AKASH2393
Params1.1B
Context2K
Smallest2.2 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · SansarK
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · thecodehaider
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · iamahmadsaboor
Params1.1B
Context2K
Smallest1.2 GB
Coding
TI
tinyllama-alpaca-ruralcare-v6
Tinyllama · Crimsoin
Params1.1B
Context4K
Smallest2.2 GB
GGUF
TI
gguf TINYLLAMA dqg v6a q8 0
Tinyllama · cvzion
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
TinyLlama 1.1B 2024
Tinyllama · luuuuuuca
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
Tinyllama 15M
Tinyllama · elvinmarkmv
Params15M
Context256
Q4_K_M0.0 GB
GGUF
TI
tinyllama medical
Tinyllama · Elkhayyat17
Params6.74B
Context2K
Smallest2.2 GB
GGUF
TI
tiny_model
Tinyllama · daid
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama-de-stage2-v0.7
Tinyllama · s3nh
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
magnus_opus_adapter
Tinyllama · AIExperimentlab
Params13M
Context—
Smallest0.0 GB
GGUF
TI
4b Tinyllama Q8 0
Tinyllama · Fischerboot
Params3.74B
Context2K
Smallest4.0 GB
GGUF
TI
TinyLlama 1.1B Intermediate Step 715k 1.5T
Tinyllama · tensorblock
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
tinyllama symptom extractor 4bit
Tinyllama · biololab
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · medel
Params1.1B
Context2K
Smallest0.1 GB
GGUF
TI
TinyLlama 1.1B Chat v1.0
Tinyllama · lehungquangminh
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
TinyLlama 1.1B Chat SFT Alpaca Cleaned
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
Tinyllama Crysis
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
TI
TinyLlama_v1.1
Tinyllama · harishkumar12k
Params1.1B
Context2K
Smallest0.4 GB
GGUF
TI
TinyLlama Finetune TRL DrArif
Tinyllama · Abeehaaa
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
testtiny_q4_k_m_gguf
Tinyllama · dadabu
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
BharatBuddy Merged
Tinyllama · Jaiking001
Params1.1B
Context2K
Smallest2.2 GB
Coding
TI
TinyLlama_v1.1_math_code
Tinyllama · mjschock
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tinyllama Chat
Tinyllama · unclemusclez
Params1.1B
Context2K
Smallest0.6 GB
GGUF
TI
TinyLlama 1.1B Chat v0.6
Tinyllama · devisri050
Params1.1B
Context2K
Smallest0.6 GB
Coding

Keep browsing