SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SplitSubdirSmolLM3
SmolLM · owalsh
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Math 431k S
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
vayuchat smollm2 360m ft
SmolLM · Nipun
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2-135M-CPP-Lua-Code
SmolLM · zessbin
Params163M
Context8K
Smallest0.7 GB
SM
smollm 360m recipe
SmolLM · danieldsachs
Params362M
Context2K
Smallest0.7 GB
SM
osg ai
SmolLM · anhvlt-2k6
Params1.71B
Context8K
Smallest1.8 GB
SM
Sakura SmolLM2 135M Instruct
SmolLM · webmp3
Params135M
Context8K
Smallest0.1 GB
SM
Smollm 135m
SmolLM · dimondim0nych
Params135M
Context2K
Smallest0.5 GB