SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
smollm2 mentalhealth 360m
SmolLM · dzur658
Params362M
Context8K
Smallest0.7 GB
GGUF
SM
smollm2 thinking q4 k m
SmolLM · Algorithmica
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning
SM
TrelisLM smollm distil
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-135M-CPP-Lua-Code
SmolLM · zessbin
Params163M
Context8K
Smallest0.7 GB
Coding
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v0.1 Attribution
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
smollm2 135m monkesearch
SmolLM · kishl
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · thepethen
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135 Q4 K M Lora 500
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm 1.7b compact
SmolLM · JSCreatorPro
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-MagpieUltra-v2
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-ablation-OH-v2
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Full Dataset
SmolLM · Alptekinege
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Q4 K M Lora 30
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm2 256x135M
SmolLM · Disya
Params20.4B
Context8K
Smallest21.7 GB
GGUF
SM
model SFT SmolLM3 3B
SmolLM · Sr-Carlos
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
smolLM2
SmolLM · tuan-jason
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
smolLM2 135M
SmolLM · tuancoltech
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
Smollm2 instruct
SmolLM · EnyxD
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · dpalyvos
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
smollm q
SmolLM · Brijesh-Info
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
Cambridge KAIST2 SmolLM 14m Dolma v0.1 Base tied
SmolLM · RichardErkhov
Params8M
Context2K
Q4_K_M0.0 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · nsatya
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · kevinharry
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
grpathak22 smolLM marathi v2
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-Arlind
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
golden smollm2 135m v2
SmolLM · mburaksayici
Params135M
Context8K
Smallest0.1 GB
GGUF

Keep browsing