SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2 135M Instruct
SmolLM · nns-hashtags
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset_d2niraj
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 360M
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
SM
noonlight SmolLM2 FT MyDataset
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Nearest 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 135M Layer Pruned 90M Raw
SmolLM · RichardErkhov
Params99M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-MagPiePro
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
boop 360m
SmolLM · bunnyweb
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 135M Instruct
SmolLM · Dev-in-the-BM
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm Gutenberg 1 2 3 4
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 Rethink 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct imatrix
SmolLM · liodon-ai
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 360M Instruct
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · aa1602295777
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Train 431k Classification
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 360M TigerMath Evaluated SFT
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM 135M Instruct DEVINator v0.2
SmolLM · unclemusclez
Params135M
Context2K
Smallest0.3 GB
SM
tcapelle toxicity scorer smollm2 135m it freeze
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-Arabic_Reasoning_Instruct_QA
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
HuggingFaceTB SmolLM2 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB