Tiny GGUF models

150 GGUF models in the Tiny family, quantized by 51 uploaders. Sizes run from 3M to 3.88B parameters. The longest trained context is 488K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
TI
Tiny Darkllama
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
Roleplay
TI
Tiny Random Orion
Tiny · itlwas
Params22M
Context256
Q4_K_M0.0 GB
GGUF
TI
TinyLlama 1.1B DPO Sin Censura V2
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
GGUF
TI
Tiny Aya Water
Tiny · erenyeager-1
Params3.35B
Context8K
Smallest2.0 GB
GGUF
TI
UNCEN.NSFW ResidentTiny 1.1B DPO
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
Roleplay
TI
Tiny Llm Maui Expressions Gguf
Tiny · VarunNagaraj
Params3.82B
Context4K
Q4_K_M2.3 GB
GGUF
TI
tiny summarizer v1
Tiny · ambrosfitz
Params1.1B
Context4K
Q4_K_M0.7 GB
GGUF
TI
tiny stories 50m
Tiny · evanhugging
Params51M
Context512
Smallest0.1 GB
GGUF
TI
Tiny DarkLlama
Tiny · mrcuddle
Params1.1B
Context4K
Smallest0.8 GB
GGUF
TI
Tiny Aya Water
Tiny · keisuke-miyako
Params3.35B
Context488K
Smallest3.6 GB
GGUF
TI
tiny random cohere
Tiny · tensorblock
Params137M
Context128K
Smallest0.1 GB
GGUF
TI
tiny random gpt2
Tiny · tensorblock
Params13M
Context1K
Smallest0.0 GB
GGUF
TI
Tiny Aya Water
Tiny · Manojb
Params3.35B
Context488K
Smallest6.7 GB
GGUF
TI
My_Tiny_V1_Finetuned
Tiny · Kfjjdjdjdhdhd
Params13M
Context1K
Smallest0.0 GB
GGUF
TI
Tiny lamina llm
Tiny · Clemylia
Params—
Context150
Smallest0.0 GB
GGUF
TI
tiny codes it assistant
Tiny · nihal06
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
TI
tiny random exaone
Tiny · tensorblock
Params237M
Context4K
Smallest0.1 GB
GGUF
TI
tiny aya urdu roman transliteration
Tiny · ogx786
Params3.35B
Context8K
Smallest6.7 GB
GGUF
TI
Tiny Lama sentimet
Tiny · ISTNetworks
Params1.1B
Context2K
Smallest1.2 GB
GGUF
TI
Tiny Aya Earth Yoruba Merged
Tiny · HusseinAlamutu
Params3.35B
Context8K
Q4_K_M2.1 GB
GGUF
TI
Tiny Random Orion
Tiny · RichardErkhov
Params22M
Context256
Q4_K_M0.0 GB
GGUF
TI
tiny coder
Tiny · rizzdeep
Params1.1B
Context2K
Q4_K_M0.7 GB
Coding
TI
Tiny_T5_De
Tiny · philipp-zettl
Params9M
Context512
Q4_K_M0.0 GB
GGUF
TI
Tiny lamma
Tiny · Anoopuk
Params1.1B
Context2K
Smallest0.6 GB
GGUF
TI
Tiny Aya Water
Tiny · Manojb
Params3.35B
Context488K
Smallest6.7 GB
GGUF
TI
NSFW ResidentTiny 1.1B DPO
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
Roleplay
TI
Darkllama3.2 1B RPGateway School
Tiny · Novaciano
Params1.1B
Context2K
Smallest0.8 GB
Roleplay
TI
Tiny llamix_2x1B
Tiny · RichardErkhov
Params1.86B
Context2K
Q4_K_M1.1 GB
GGUF
TI
my tiny v1 Q2 K
Tiny · Kfjjdjdjdhdhd
Params13M
Context1K
Smallest0.0 GB
GGUF
TI
Tiny lamina english fragment
Tiny · Clem-CPu
Params—
Context150
Smallest0.0 GB
GGUF

Keep browsing