Stheno GGUF models

127 GGUF models in the Stheno family, quantized by 45 uploaders. Sizes run from 8B to 49.5B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ST
L3 8B Stheno v3.2 Heretic
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · Dragnbrn
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 8B Stheno v3.2
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 8B Stheno v3.2
Stheno · tensorblock
Params8.03B
Context8K
Smallest3.2 GB
GGUF
ST
Stheno v2 Delta
Stheno · TheBloke
Params13B
Context4K
Q4_K_M7.9 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · backyardai
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 8B Stheno v3.2 MPOA i1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Sao10K.L3 8B Stheno v3.2
Stheno · DevQuasar
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
R1 Stheno 8B i1
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
ReasoningTool use
ST
Sao10K/L3-8B-Stheno-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
ST
L3 Stheno Maid Blackroot Grand HORROR 16B
Stheno · backyardai
Params16.5B
Context8K
Q4_K_M10.0 GB
GGUF
ST
L3 3.3 8B Stheno Maid Mahou
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
L3 3.3 8B Stheno Maid Mahou Heretic
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
Stheno Hercules 3.1 8B
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
L3 8B Stheno v3.2
Stheno · l3utterfly
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3-8B-Stheno-v3.1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 8B Stheno v3.3 32K
Stheno · RichardErkhov
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · linuu1
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
ST
L3 Stheno v3.2 12.2B Instruct
Stheno · mradermacher
Params12.2B
Context8K
Q4_K_M7.4 GB
GGUF
ST
L3-8B-Stheno-v3.2
Stheno · Den4iiks
Params8.03B
Context8K
Q4_K_M4.9 GB
Roleplay
ST
nothingiisreal/L3-8B-Stheno-Horny-v3.3-32K
Stheno · featherless-ai-quants
Params8.03B
Context32K
Q4_K_M4.9 GB
GGUF
ST
L3 8B Stheno slerp i1
Stheno · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stheno-Mega-False-49B-L2
Stheno · RichardErkhov
Params49.5B
Context4K
Q4_K_M29.8 GB
GGUF
ST
L3 8B Stheno v3.2 Q4 K M
Stheno · Peeb22557
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Stheno Hercules 3.1 8B i1
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
ST
L3 Stheno v3.2 12.2B Instruct
Stheno · mradermacher
Params12.2B
Context8K
Q4_K_M7.4 GB
GGUF
ST
L3 8B Stheno v3.2
Stheno · matrixportalx
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
Sao10K/L3-8B-Stheno-v3.2
Stheno · featherless-ai-quants
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 8B Stheno v3.2
Stheno · RichardErkhov
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
ST
L3 3.3 8B Stheno Maid Mahou
Stheno · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use

Keep browsing