Stheno GGUF models
127 GGUF models in the Stheno family, quantized by 45 uploaders. Sizes run from 8B to 49.5B parameters. The longest trained context is 128K tokens.
ST
Stheno Hercules 3.1 8B
Stheno · matrixportalx
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
L3-15B-Stheno-Passthrough
Stheno · jsfs11
Params15B
Context8K
Smallest16.0 GB
ST
L3-8B-Stheno-slerp
Stheno · jsfs11
Params8.03B
Context8K
Smallest8.5 GB
ST
L3-8B-Stheno-v3.1
Stheno · ljredux
Params8.03B
Context8K
Smallest8.5 GB
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest14.5 GB
ST
L3 8B Stheno v3.2 Q8 0
Stheno · DebadityaMalakar
Params8.03B
Context8K
Smallest8.5 GB
ST
L3-8B-Stheno-2x8B-MoE
Stheno · jsfs11
Params13.7B
Context8K
Smallest9.7 GB