Stheno GGUF models

127 GGUF models in the Stheno family, quantized by 45 uploaders. Sizes run from 8B to 49.5B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ST
L3-8B-Stheno-v3.1
Stheno · LiteLLMs
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stheno-1.3-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3 8B Stheno v3.3 32K
Stheno · tensorblock
Params8.03B
Context32K
Smallest3.2 GB
GGUF
ST
L3 3.3 8B Stheno Maid Mahou Heretic
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3 8B Stheno slerp
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 Stheno Maid Blackroot Grand HORROR 16B i1
Stheno · mradermacher
Params16.5B
Context8K
Q4_K_M10.0 GB
GGUF
ST
Stheno Biggened 13b
Stheno · mradermacher
Params12.4B
Context8K
Q4_K_M7.5 GB
GGUF
ST
L3-8B-Stheno-2x8B-MoE
Stheno · mradermacher
Params13.7B
Context8K
Q4_K_M8.3 GB
GGUF
ST
L3 8B Stheno Horny v3.3 32K Q4 K S
Stheno · matrixportalx
Params8.03B
Context32K
Smallest4.7 GB
GGUF
ST
L3 8B Stheno v3.2 Q4 K M
Stheno · eastcastle
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3-8B-Stheno-Horny-v3.3-32K
Stheno · Kurgan1138
Params8.03B
Context32K
Smallest5.7 GB
GGUF
ST
L3 Nymeria 8B
Stheno · QuantFactory
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
ST
Stheno-1.3-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Stheno-Mix-L2-20B
Stheno · mradermacher
Params20.6B
Context4K
Q4_K_M12.4 GB
GGUF
ST
Stheno L2 13B i
Stheno · SolidSnacke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
Stheno-1.1-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3 8B Stheno v3.2
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stheno-Mega-False-49B-L2
Stheno · mradermacher
Params49.5B
Context4K
Q4_K_M29.8 GB
GGUF
ST
L3-15B-Stheno-Passthrough
Stheno · mradermacher
Params15B
Context8K
Q4_K_M9.1 GB
GGUF
ST
L3 8B Stheno v3.2 Q4 K S
Stheno · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF
ST
Stheno-Mega-False-49B-L2
Stheno · mradermacher
Params49.5B
Context4K
Q4_K_M29.8 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · HenryyTwitchyfinger
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stheno-Inverted-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · cattoroboto
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stheno-TheSpice-v1
Stheno · lik07
Params8.03B
Context8K
Smallest5.7 GB
GGUF
ST
Stheno-1.1-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3 8B Stheno v3.3 32K
Stheno · matrixportalx
Params8.03B
Context32K
Smallest4.0 GB
GGUF
ST
Stheno-1.2-L2-13B
Stheno · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3 8B Stheno v3.2 Q4 0
Stheno · matrixportalx
Params8.03B
Context8K
Smallest4.7 GB
GGUF

Keep browsing