Small GGUF models

73 GGUF models in the Small family, quantized by 44 uploaders. Sizes run from 13M to 221B parameters. The longest trained context is 256K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
e5 small v2 gguf q4 k m
Small · keisuke-miyako
Params33M
Context512
Q4_K_M0.0 GB
GGUF
SM
T5 Small
Small · phoenix-gurl
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
small 1 rl 384 Q8 0
Small · willfaustcuber
Params494M
Context32K
Smallest0.5 GB
Tool use
SM
Small Hikari v0.2 Q8 0
Small · Rookied
Params2.61B
Context8K
Smallest2.8 GB
GGUF
SM
T5 Small
Small · devisri050
Params61M
Context512
Smallest0.1 GB
GGUF
SM
Small Inteligence
Small · gamerjisir
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
mt0 small Q2 K
Small · larenspear
Params300M
Context512
Smallest0.2 GB
GGUF
SM
Mt5 Small
Small · alig01
Params300M
Context512
Q4_K_M0.2 GB
GGUF
SM
T5 Small
Small · egrhfnfdg
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
e5 small v2 Q4 K M
Small · thomasht86
Params33M
Context512
Q4_K_M0.0 GB
Embedding
SM
T5 Small
Small · ahmeddawood
Params61M
Context512
Q4_K_M0.0 GB
GGUF
SM
t5 small loan eligibility 80M
Small · LazyCoder13
Params77M
Context512
Smallest0.1 GB
Coding
SM
my small llm rehost
Small · chesswiz2025
Params2.51B
Context8K
Smallest0.9 GB
GGUF

Keep browsing