Stheno GGUF models
127 GGUF models in the Stheno family, quantized by 45 uploaders. Sizes run from 8B to 49.5B parameters. The longest trained context is 128K tokens.
ST
L3-8B-Stheno-v3.1
Stheno · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stheno-1.3-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3 8B Stheno v3.3 32K
Stheno · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
ST
L3 3.3 8B Stheno Maid Mahou Heretic
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3 8B Stheno slerp
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3 Stheno Maid Blackroot Grand HORROR 16B i1
Stheno · mradermacher
Params16.5B
Context8K
Q4_K_M10.0 GB
ST
Stheno Biggened 13b
Stheno · mradermacher
Params12.4B
Context8K
Q4_K_M7.5 GB
ST
L3-8B-Stheno-2x8B-MoE
Stheno · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
ST
L3 8B Stheno Horny v3.3 32K Q4 K S
Stheno · matrixportalx
Params8.03B
Context32K
Smallest4.7 GB
ST
L3 8B Stheno v3.2 Q4 K M
Stheno · eastcastle
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-Horny-v3.3-32K
Stheno · Kurgan1138
Params8.03B
Context32K
Smallest5.7 GB
ST
L3 Nymeria 8B
Stheno · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stheno-1.3-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
Stheno-Mix-L2-20B
Stheno · mradermacher
Params20.6B
Context4K
Q4_K_M12.4 GB
ST
Stheno L2 13B i
Stheno · SolidSnacke
Params13B
Context4K
Q4_K_M7.9 GB
ST
Stheno-1.1-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3 8B Stheno v3.2
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stheno-Mega-False-49B-L2
Stheno · mradermacher
Params49.5B
Context4K
Q4_K_M29.8 GB
ST
L3-15B-Stheno-Passthrough
Stheno · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
ST
L3 8B Stheno v3.2 Q4 K S
Stheno · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
ST
Stheno-Mega-False-49B-L2
Stheno · mradermacher
Params49.5B
Context4K
Q4_K_M29.8 GB
ST
L3-8B-Stheno-v3.2
Stheno · HenryyTwitchyfinger
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stheno-Inverted-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3-8B-Stheno-v3.2
Stheno · cattoroboto
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stheno-TheSpice-v1
Stheno · lik07
Params8.03B
Context8K
Smallest5.7 GB
ST
Stheno-1.1-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3 8B Stheno v3.3 32K
Stheno · matrixportalx
Params8.03B
Context32K
Smallest4.0 GB
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3 8B Stheno v3.2 Q4 0
Stheno · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB