Stheno GGUF models

127 GGUF models in the Stheno family, quantized by 45 uploaders. Sizes run from 8B to 49.5B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ST
Stheno Hercules 3.1 8B
Stheno · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
L3-15B-Stheno-Passthrough
Stheno · jsfs11
Params15B
Context8K
Smallest16.0 GB
GGUF
ST
L3-8B-Stheno-slerp
Stheno · jsfs11
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ST
L3-8B-Stheno-v3.1
Stheno · ljredux
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest14.5 GB
GGUF
ST
L3 8B Stheno v3.2 Q8 0
Stheno · DebadityaMalakar
Params8.03B
Context8K
Smallest8.5 GB
GGUF
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest9.7 GB
GGUF

Keep browsing