SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B Instruct
SmolLM · Maites
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · lukejoe
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · itlwas
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · w3schoolstotallylegit
Params1.71B
Context8K
Smallest1.4 GB
GGUF
SM
minFjollede
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · w3schoolstotallylegit
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Scheduled QAT Linear
SmolLM · jpcurada
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Instruct Q4 K M
SmolLM · mjdousti
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · QuantLLM
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-LongCoT
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · dispatchAI
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B logtriage
SmolLM · shubham-alyan24
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
tankbattle jev smollm2 135m
SmolLM · andrewaldrichnet
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
lumynax infused smollm2 17b
SmolLM · AbteeXAILab
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · Emilio407
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
buleyean smollm2 360m
SmolLM · forkjoin-ai
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct.Q4 K M
SmolLM · Haijun-AI
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · RunSLM-AI
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · 1bit-MONSTER
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B
SmolLM · w3schoolstotallylegit
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · chatpdflocal
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
Gemma 3 270m It Web Agent 16bit
SmolLM · ArunKr
Params268M
Context32K
Smallest0.3 GB
GGUF
SM
mcdelivery
SmolLM · Shay1309
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · liamhvn
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing