SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 135M GEC
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 360M
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-360M-Instruct-K12-5000
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM3 3B Heretic
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 135M Instruct
SmolLM · gnh1201
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2 135M Instruct TIFA
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-BigCodeSmallTalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Loss
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
Smollm2-360m-instruct-valheim-2
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Query Scores 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
FinSenti SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM3 3B GSM8K SFT
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Instruct TIFA Random
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 360M Instruct
SmolLM · xriminact
Params362M
Context2K
Smallest0.2 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 Business News Generator
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
FinalBADSmolLM2 Business News Generator
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
zenai org SmolLM prompt generator
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM3 3B Q4 K M
SmolLM · ShayonSarker
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
Huihui ai.Huihui SmolLM3 3B Abliterated
SmolLM · DevQuasar
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · gaianet
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
gguf SmolLM 360M Instruct
SmolLM · Felladrin
Params362M
Context2K
Smallest0.2 GB
SM
SmolLM2 1.7B Instruct Obliteratus
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 135M Instruct Jailbroken
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
PARM 2 Tiny Instruct 1.7B QwQ o1
SmolLM · Pinkstack
Params1.71B
Context8K
Q4_K_M1.1 GB