Stablelm GGUF models

117 GGUF models in the Stablelm family, quantized by 46 uploaders. Sizes run from 1.64B to 12.1B parameters. The longest trained context is 4K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
ST
StableLM 2 1.6B Chat
Stablelm · antoste
Params1.64B
Context4K
Smallest0.9 GB
Tool use
ST
stablelm-2-1_6b-chat
Stablelm · mrmage
Params1.64B
Context4K
Smallest1.2 GB
Tool use
ST
rocket-3B
Stablelm · newsletter
Params2.8B
Context4K
Smallest2.3 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · kurros
Params1.64B
Context4K
Smallest0.9 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · SourPineapple
Params1.64B
Context4K
Smallest1.2 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · kurros
Params1.64B
Context4K
Smallest1.2 GB
GGUF
ST
stablelm-2-1_6b-chat
Stablelm · Emilio407
Params1.64B
Context4K
Smallest3.3 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · kurros
Params1.64B
Context4K
Smallest1.2 GB
GGUF
ST
stablelm-zephyr-3b
Stablelm · shidowake
Params2.8B
Context4K
Smallest2.0 GB
GGUF
ST
stablelm-2-zephyr-1_6b
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.0 GB
GGUF
ST
stablelm-3b-4e1t_test-Legal
Stablelm · Shreyas0706
Params2.8B
Context4K
Smallest5.6 GB
GGUF
ST
Stabilityai Stablelm 2 12b Chat
Stablelm · tensorblock
Params12.1B
Context4K
Smallest4.7 GB
Tool use
ST
stablelm-zephyr-3b
Stablelm · cosmo3769
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
ST
Vega 1 6B
Stablelm · ElMater06
Params6B
Context—
Smallest0.0 GB
GGUF
ST
stablelm-2-1_6b-chat
Stablelm · Felladrin
Params1.64B
Context4K
Smallest1.8 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · ysn-rfd
Params2.8B
Context4K
Smallest1.1 GB
GGUF
ST
stablelm-zephyr-3b
Stablelm · Nishant2609
Params2.8B
Context4K
Smallest5.6 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · matrixportalx
Params2.8B
Context4K
Smallest1.6 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · Tien-THM
Params2.8B
Context4K
Q4_K_M1.7 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · skarmani
Params2.8B
Context4K
Smallest2.0 GB
GGUF
ST
Stablelm Zephyr 3b
Stablelm · PuneethReddy
Params2.8B
Context4K
Smallest2.0 GB
GGUF
ST
coze stablelm 2 1 6b
Stablelm · vincevas
Params1.64B
Context—
Smallest1.0 GB
GGUF
ST
StableLM 2 1.6B Chat
Stablelm · antoste
Params1.64B
Context4K
Smallest1.0 GB
Tool use
ST
Stablelm 2 12b Chat
Stablelm · RichardErkhov
Params12.1B
Context4K
Smallest4.7 GB
GGUF
ST
stablelm zephyr 3b quantized
Stablelm · anchylosis
Params2.8B
Context—
Smallest1.6 GB
GGUF
ST
ar stablelm 2 chat
Stablelm · stabilityai
Params1.64B
Context4K
Smallest1.8 GB
GGUF
ST
cisco inam
Stablelm · ndavidson
Params2.8B
Context4K
Smallest1.7 GB
GGUF

Keep browsing