SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
Boollm Small 135M
SmolLM · Boollm
Params135M
Context8K
Smallest0.1 GB
SM
gguf sharded Q4 K S SmolLM2 135M Instruct
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
SM
dhilipsiva twin
SmolLM · dhilipsiva
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 360M TigerMath Evaluated EvolQuality SFT
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM3 3B Power
SmolLM · librepowerai
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Magpie Ultra v0.1 Train Query
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
smollm 1.7b
SmolLM · neopolita
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
Summarizer
SmolLM · DustySoul1
Params362M
Context8K
Q4_K_M0.3 GB
SM
TwinSmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Classification
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM3 3B
SmolLM · WorkOffline
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2-FT-Russian2
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Instruct Layer Pruned 90M Raw
SmolLM · mradermacher
Params99M
Context2K
Q4_K_M0.1 GB
SM
Sft_Smollm_Base_V2
SmolLM · RichardErkhov
Params163M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct skill B
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
terllm
SmolLM · partum
Params135M
Context8K
Q4_K_M0.1 GB
SM
Bart Cnn Quant
SmolLM · ar08
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 Autocomplete 135M KomorAI
SmolLM · KomorAI
Params135M
Context8K
Smallest0.3 GB
SM
smollm3 expert governance 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
small function calling
SmolLM · archit11
Params152M
Context2K
Smallest0.2 GB
SM
SmolLM2 1.7 Roleplay
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 360M Instruct TigerMath Evaluated EvolQuality DPO
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm2 135m clinical note
SmolLM · costinstroie
Params135M
Context8K
Q4_K_M0.1 GB