Starling GGUF models
71 GGUF models in the Starling family, quantized by 33 uploaders. Sizes run from 6.74B to 46.7B parameters. The longest trained context is 128K tokens.
ST
Starling LM 7B beta
Starling · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
Starling LM 7B alpha Q4 K M
Starling · RaincloudAi
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
berkeley-nest_starling-lm-7b-alpha
Starling · llmware
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
Starling LM 7B alpha Q4 K M
Starling · FaolanKusibo
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
Starling-JP-7B
Starling · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
ST
Starling LM 7B beta
Starling · splusminusx
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
starling beta 7b
Starling · sonu2023
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
Starling LM 7B beta
Starling · Mirsad
Params7.24B
Context8K
Smallest3.1 GB
ST
Starling-JP-7B
Starling · HawkClaws
Params7.24B
Context4K
Smallest7.7 GB
ST
Starling LM 7B alpha GGUF Q4 K M
Starling · kaashh02
Params7.24B
Context8K
Q4_K_M4.4 GB
ST
Starling LM 11B alpha Q4 K M
Starling · ttkciar
Params10.7B
Context8K
Q4_K_M6.5 GB