Stheno GGUF models
127 GGUF models in the Stheno family, quantized by 45 uploaders. Sizes run from 8B to 49.5B parameters. The longest trained context is 128K tokens.
ST
L3 8B Stheno v3.2 Heretic
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-v3.2
Stheno · Dragnbrn
Params8B
Context8K
Q4_K_M4.9 GB
ST
L3 8B Stheno v3.2
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3 8B Stheno v3.2
Stheno · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
ST
Stheno v2 Delta
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
ST
L3-8B-Stheno-v3.2
Stheno · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3 8B Stheno v3.2 MPOA i1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Sao10K.L3 8B Stheno v3.2
Stheno · DevQuasar
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
R1 Stheno 8B i1
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
Sao10K/L3-8B-Stheno-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
ST
L3 Stheno Maid Blackroot Grand HORROR 16B
Stheno · backyardai
Params16.5B
Context8K
Q4_K_M10.0 GB
ST
L3 3.3 8B Stheno Maid Mahou
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
L3 3.3 8B Stheno Maid Mahou Heretic
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
Stheno Hercules 3.1 8B
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
L3 8B Stheno v3.2
Stheno · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-v3.1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3 8B Stheno v3.3 32K
Stheno · RichardErkhov
Params8.03B
Context32K
Q4_K_M4.9 GB
ST
L3-8B-Stheno-v3.2
Stheno · linuu1
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3 Stheno v3.2 12.2B Instruct
Stheno · mradermacher
Params12.2B
Context8K
Q4_K_M7.4 GB
ST
L3-8B-Stheno-v3.2
Stheno · Den4iiks
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
ST
L3 8B Stheno slerp i1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stheno-Mega-False-49B-L2
Stheno · RichardErkhov
Params49.5B
Context4K
Q4_K_M29.8 GB
ST
L3 8B Stheno v3.2 Q4 K M
Stheno · Peeb22557
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Stheno Hercules 3.1 8B i1
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ST
L3 Stheno v3.2 12.2B Instruct
Stheno · mradermacher
Params12.2B
Context8K
Q4_K_M7.4 GB
ST
L3 8B Stheno v3.2
Stheno · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
Sao10K/L3-8B-Stheno-v3.2
Stheno · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3 8B Stheno v3.2
Stheno · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
ST
L3 3.3 8B Stheno Maid Mahou
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB