SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
smollm2 mentalhealth 360m
SmolLM · dzur658
Params362M
Context8K
Smallest0.7 GB
SM
smollm2 thinking q4 k m
SmolLM · Algorithmica
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
TrelisLM smollm distil
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-135M-CPP-Lua-Code
SmolLM · zessbin
Params163M
Context8K
Smallest0.7 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v0.1 Attribution
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
smollm2 135m monkesearch
SmolLM · kishl
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M
SmolLM · thepethen
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 1.7B
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 135 Q4 K M Lora 500
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm 1.7b compact
SmolLM · JSCreatorPro
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-MagpieUltra-v2
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-ablation-OH-v2
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Full Dataset
SmolLM · Alptekinege
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M Q4 K M Lora 30
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm2 256x135M
SmolLM · Disya
Params20.4B
Context8K
Smallest21.7 GB
SM
model SFT SmolLM3 3B
SmolLM · Sr-Carlos
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
smolLM2
SmolLM · tuan-jason
Params135M
Context8K
Smallest0.1 GB
SM
smolLM2 135M
SmolLM · tuancoltech
Params135M
Context8K
Smallest0.1 GB
SM
Smollm2 instruct
SmolLM · EnyxD
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM 135M
SmolLM · dpalyvos
Params135M
Context2K
Q4_K_M0.1 GB
SM
smollm q
SmolLM · Brijesh-Info
Params362M
Context2K
Q4_K_M0.3 GB
SM
Cambridge KAIST2 SmolLM 14m Dolma v0.1 Base tied
SmolLM · RichardErkhov
Params8M
Context2K
Q4_K_M0.0 GB
SM
SmolLM2 135M Instruct
SmolLM · nsatya
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M
SmolLM · kevinharry
Params135M
Context8K
Smallest0.1 GB
SM
grpathak22 smolLM marathi v2
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-Arlind
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
golden smollm2 135m v2
SmolLM · mburaksayici
Params135M
Context8K
Smallest0.1 GB