SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2 1.7b maths orpo
SmolLM · BrainWave-ML
Params1.71B
Context31K
Q4_K_M1.1 GB
SM
minSode
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
SM
SmoLlm3python 3B
SmolLM · Lerelou
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
meeTARA SmolLM2 1.7b Spark_Enhanced
SmolLM · meetara-spark
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7b orpo chat
SmolLM · BrainWave-ML
Params1.71B
Context31K
Q4_K_M1.1 GB
SM
SmolLM2 360M Instruct
SmolLM · jc-builds
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M GEC
SmolLM · SupratimRK
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2-MagpieUltraPlus-MathInstruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM3 3B GSM8K SFT
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM3 3B distilled py
SmolLM · rdubwiley
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 135M Emotions
SmolLM · dianak12
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · mukel
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-360M-Rickified-GRPO
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Query Rating 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
HRChatbotintent_unsloth_SmolLM2 135M Instruct Bnb 4bit
SmolLM · jiya2
Params135M
Context8K
Q4_K_M0.1 GB
SM
ExtractQueNumberMini
SmolLM · rahulvk007
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3-Custom-SFT
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Instruct
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B
SmolLM · prithivMLmods
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · leeminwaan
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-Race
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM FT CoEdIT
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 360M
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB