Starling GGUF models

71 GGUF models in the Starling family, quantized by 33 uploaders. Sizes run from 6.74B to 46.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ST
Starling LM 7B Beta
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
ST
Starling dolphin E26 7B
Starling · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
starling 7B
Starling · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
ST
Starling LM 7B beta
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling-LM-7B-beta-x2
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
bunnycore/Starling-dolphin-E26-7B
Starling · featherless-ai-quants
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 11B Alpha
Starling · mradermacher
Params10.7B
Context32K
Q4_K_M6.5 GB
GGUF
ST
Starling-dolphin-E26-7B
Starling · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B alpha
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B beta LaserRMT v1
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B alpha
Starling · rob-x-ai
Params7.24B
Context8K
Smallest4.4 GB
GGUF
ST
Starling-LM-7B-alpha-x2
Starling · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling Monarch Westlake Garten 7B v0.1
Starling · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B beta ExPO
Starling · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
ST
Starling Monarch Westlake Garten 7B v0.1 i1
Starling · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Starling-LM-11B-alpha
Starling · RichardErkhov
Params11.4B
Context8K
Q4_K_M6.8 GB
GGUF
ST
Starling LM 7B beta
Starling · LoneStriker
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B alpha
Starling · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
ST
Starling LM 7B beta
Starling · tensorblock
Params7.24B
Context8K
Smallest2.7 GB
GGUF
ST
Starling LM 11B Alpha
Starling · tensorblock
Params10.7B
Context32K
Smallest4.0 GB
GGUF
ST
Starling LM 10.7B beta
Starling · mradermacher
Params10.7B
Context8K
Q4_K_M6.6 GB
GGUF
ST
starling 7b raft ft
Starling · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
ST
Starling LM 7B beta IQ4 NL
Starling · hellork
Params7.24B
Context8K
Smallest4.1 GB
GGUF
ST
Starling LM 7B beta laser dpo Q5 K M
Starling · bunnycore
Params7.24B
Context8K
Smallest5.1 GB
GGUF
ST
Starling LM 7B beta Q6 K
Starling · newsletter
Params7.24B
Context8K
Smallest5.9 GB
GGUF
ST
Starling LM 7B beta
Starling · cstr
Params7.24B
Context8K
Smallest4.4 GB
GGUF
ST
Starling-LM-7B-beta-GGUF
Starling · AlekseyElygin
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
starling lm 7b beta
Starling · neopolita
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling dolphin E26 7B Q5 K M
Starling · bunnycore
Params7.24B
Context32K
Smallest5.1 GB
GGUF
ST
Starling LM 7B beta
Starling · Impulse2000
Params7.24B
Context8K
Smallest2.7 GB
GGUF

Keep browsing