SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
andthattoo subquery SmolLM
SmolLM · RichardErkhov
Params152M
Context2K
Q4_K_M0.1 GB
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
SM
MSU
SmolLM · Liquid1
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 360M
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2 135M
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Medilite
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
Sub Lattice v3 18M Poincare Hybrid
SmolLM · DuoNeural
Params18M
Context512
Q4_K_M0.0 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
lumynax infused smollm3 3b
SmolLM · AbteeXAILab
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 360M Instruct
SmolLM · matheusUema
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 135M Instruct
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
TinyLlama SmolLM
SmolLM · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
SM
OpenR1-SmolLM2-1.7B-Instruct-Agentic
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · backpack-run
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Random
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Math 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2_135m_tuned
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm2-360m-instruct-valheim
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 135M Instruct
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
Kurtis SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
smollm3 expert graphrag 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
smollm2-sft-test1
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Instruct DEVINator v0.1
SmolLM · unclemusclez
Params135M
Context2K
Smallest0.3 GB
SM
Smollm3
SmolLM · yasserrmd
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM 360M Instruct TigerMath Evaluated EvolQuality SFT
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB