Small GGUF models

73 GGUF models in the Small family, quantized by 44 uploaders. Sizes run from 13M to 221B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
Mt5 Small
Small · Matheusrdsantos
Params300M
Context512
Q4_K_M0.2 GB
GGUF
SM
T5 Small
Small · layonsan
Params61M
Context512
Smallest0.1 GB
GGUF
SM
e5 small v2 Q8 0
Small · rockon1095
Params33M
Context512
Smallest0.0 GB
Embedding
SM
T5 Small
Small · asdfasdasda
Params61M
Context512
Smallest0.1 GB
GGUF
SM
T5 V1_1 Small
Small · jukkim046
Params77M
Context512
Smallest0.1 GB
GGUF
SM
T5 Small
Small · neatscissors
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
Small_Tiny_V1
Small · Hjgugugjhuhjggg
Params13M
Context1K
Smallest0.0 GB
GGUF
SM
T5 Small
Small · georgegiosue
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
Mt5 Small Lm Adapt
Small · bh4
Params300M
Context512
Q4_K_M0.2 GB
GGUF
SM
T5 V1_1 Small
Small · jukkim046
Params77M
Context512
Smallest0.0 GB
GGUF
SM
T5 V1_1 Small
Small · jukkim046
Params77M
Context512
Smallest0.1 GB
GGUF
SM
T5 Small
Small · Xiaojian9992024
Params61M
Context512
Smallest0.1 GB
GGUF
SM
T5 Small
Small · layonsan
Params61M
Context512
Smallest0.1 GB
GGUF
SM
T5 Small
Small · layonsan
Params—
Context512
Smallest0.0 GB
GGUF
SM
first test weeb
Small · marantral
Params61M
Context512
Smallest0.1 GB
GGUF
SM
T5 Small
Small · layonsan
Params61M
Context512
Smallest0.1 GB
GGUF
SM
m3e small f16
Small · ZapsyQ
Params24M
Context512
Smallest0.0 GB
GGUF
SM
T5 Small
Small · enacimie
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
T5 Small
Small · agkavin
Params61M
Context512
Smallest0.1 GB
GGUF
SM
mt0 small Q4 K M
Small · theunfit
Params300M
Context512
Q4_K_M0.2 GB
GGUF
SM
Mt5 Small
Small · asdfasdasda
Params300M
Context512
Smallest0.3 GB
GGUF
SM
T5 Small
Small · ahmeddawood
Params61M
Context512
Smallest0.1 GB
GGUF
SM
e5 small v2 Q4 0
Small · rockon1095
Params33M
Context512
Smallest0.0 GB
Embedding
SM
T5 Small
Small · agkavin
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
T5 Small
Small · djkwsy2020
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
e5 small v2 gguf f16
Small · keisuke-miyako
Params33M
Context512
Smallest0.1 GB
GGUF
SM
Small Hikari v0.1 Q8 0
Small · Rookied
Params2.61B
Context8K
Smallest2.8 GB
GGUF
SM
T5 V1_1 Small
Small · jukkim046
Params77M
Context512
Q4_K_M0.1 GB
GGUF
SM
T5 Small
Small · AncientCatz
Params77M
Context512
Smallest0.1 GB
GGUF
SM
e5 small v2 gguf q8 0
Small · keisuke-miyako
Params33M
Context512
Smallest0.0 GB
GGUF

Keep browsing