SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M GEC
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-360M-Instruct-K12-5000
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B Heretic
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 135M Instruct
SmolLM · gnh1201
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct TIFA
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-BigCodeSmallTalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Loss
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Smollm2-360m-instruct-valheim-2
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Query Scores 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
FinSenti SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
Reasoning
SM
SmolLM3 3B GSM8K SFT
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
SM
SmolLM2 1.7B Instruct TIFA Random
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · xriminact
Params362M
Context2K
Smallest0.2 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 Business News Generator
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
FinalBADSmolLM2 Business News Generator
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
zenai org SmolLM prompt generator
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Q4 K M
SmolLM · ShayonSarker
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
Huihui ai.Huihui SmolLM3 3B Abliterated
SmolLM · DevQuasar
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · gaianet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
gguf SmolLM 360M Instruct
SmolLM · Felladrin
Params362M
Context2K
Smallest0.2 GB
GGUF
SM
SmolLM2 1.7B Instruct Obliteratus
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Instruct Jailbroken
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
PARM 2 Tiny Instruct 1.7B QwQ o1
SmolLM · Pinkstack
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning

Keep browsing