Small GGUF models
73 GGUF models in the Small family, quantized by 44 uploaders. Sizes run from 13M to 221B parameters. The longest trained context is 256K tokens.
SM
e5 small v2 gguf q4 k m
Small · keisuke-miyako
Params33M
Context512
Q4_K_M0.0 GB
SM
T5 Small
Small · phoenix-gurl
Params61M
Context512
Q4_K_M0.0 GB
SM
small 1 rl 384 Q8 0
Small · willfaustcuber
Params494M
Context32K
Smallest0.5 GB
SM
Small Hikari v0.2 Q8 0
Small · Rookied
Params2.61B
Context8K
Smallest2.8 GB
SM
T5 Small
Small · devisri050
Params61M
Context512
Smallest0.1 GB
SM
Small Inteligence
Small · gamerjisir
Params362M
Context8K
Q4_K_M0.3 GB
SM
mt0 small Q2 K
Small · larenspear
Params300M
Context512
Smallest0.2 GB
SM
Mt5 Small
Small · alig01
Params300M
Context512
Q4_K_M0.2 GB
SM
T5 Small
Small · egrhfnfdg
Params61M
Context512
Q4_K_M0.0 GB
SM
e5 small v2 Q4 K M
Small · thomasht86
Params33M
Context512
Q4_K_M0.0 GB
SM
T5 Small
Small · ahmeddawood
Params61M
Context512
Q4_K_M0.0 GB
SM
t5 small loan eligibility 80M
Small · LazyCoder13
Params77M
Context512
Smallest0.1 GB
SM
my small llm rehost
Small · chesswiz2025
Params2.51B
Context8K
Smallest0.9 GB