SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SplitSubdirSmolLM3
SmolLM · owalsh
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B Magpie Ultra v1.0 Math 431k S
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
vayuchat smollm2 360m ft
SmolLM · Nipun
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2-135M-CPP-Lua-Code
SmolLM · zessbin
Params163M
Context8K
Smallest0.7 GB
Coding
SM
smollm 360m recipe
SmolLM · danieldsachs
Params362M
Context2K
Smallest0.7 GB
GGUF
SM
osg ai
SmolLM · anhvlt-2k6
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
Sakura SmolLM2 135M Instruct
SmolLM · webmp3
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
Smollm 135m
SmolLM · dimondim0nych
Params135M
Context2K
Smallest0.5 GB
GGUF

Keep browsing