SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7b maths orpo
SmolLM · BrainWave-ML
Params1.71B
Context31K
Q4_K_M1.1 GB
GGUF
SM
minSode
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmoLlm3python 3B
SmolLM · Lerelou
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
meeTARA SmolLM2 1.7b Spark_Enhanced
SmolLM · meetara-spark
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7b orpo chat
SmolLM · BrainWave-ML
Params1.71B
Context31K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · jc-builds
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M GEC
SmolLM · SupratimRK
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2-MagpieUltraPlus-MathInstruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM3 3B GSM8K SFT
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
SM
SmolLM3 3B distilled py
SmolLM · rdubwiley
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 135M Emotions
SmolLM · dianak12
Params135M
Context8K
Q4_K_M0.1 GB
Tool use
SM
SmolLM2 135M Instruct
SmolLM · mukel
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-360M-Rickified-GRPO
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Query Rating 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
HRChatbotintent_unsloth_SmolLM2 135M Instruct Bnb 4bit
SmolLM · jiya2
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
ExtractQueNumberMini
SmolLM · rahulvk007
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3-Custom-SFT
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · prithivMLmods
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · leeminwaan
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-Race
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM FT CoEdIT
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing