Starling GGUF models

71 GGUF models in the Starling family, quantized by 33 uploaders. Sizes run from 6.74B to 46.7B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ST
Starling LM 7B beta
Starling · SinpxAI
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B alpha Q4 K M
Starling · RaincloudAi
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
berkeley-nest_starling-lm-7b-alpha
Starling · llmware
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B alpha Q4 K M
Starling · FaolanKusibo
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling-JP-7B
Starling · mradermacher
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B beta
Starling · splusminusx
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
starling beta 7b
Starling · sonu2023
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 7B beta
Starling · Mirsad
Params7.24B
Context8K
Smallest3.1 GB
GGUF
ST
Starling-JP-7B
Starling · HawkClaws
Params7.24B
Context4K
Smallest7.7 GB
GGUF
ST
Starling LM 7B alpha GGUF Q4 K M
Starling · kaashh02
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
ST
Starling LM 11B alpha Q4 K M
Starling · ttkciar
Params10.7B
Context8K
Q4_K_M6.5 GB
GGUF

Keep browsing