SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
qw3 smollm3 3b 1x2e 4
SmolLM · paul-stansifer
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
Merged Kudu Writer Tiny v13
SmolLM · manasdutta04
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
Sakura SmolLM2 135M Instruct BF16
SmolLM · webmp3
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB SmolLM2 1.7B Instruct
SmolLM · tensorblock
Params1.71B
Context8K
Smallest0.7 GB
GGUF
SM
smollm2 360m mate q4 k m
SmolLM · Bruno0208
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-bigcode-the-stack-smol-python
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · HuggingFaceTB
Params1.71B
Context2K
Smallest1.8 GB
Tool use
SM
SmolLM 1.7B Instruct
SmolLM · SandLogicTechnologies
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Bitnet SmolLM 135M
SmolLM · tensorblock
Params66M
Context768
Smallest0.0 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
Meditation Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest1.6 GB
GGUF
SM
Smollm Wizard Vicuna
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB SmolLM2 360M
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM2-FT-MyDatasetv1
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
BUILDINGPLAN SmolLM.360M smallset
SmolLM · transitionGap
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
prithivMLmods.SmolLM2 135M Grpo Gsm8k
SmolLM · DevQuasar-2
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Sub Lattice 17M Poincare Instruct
SmolLM · DuoNeural
Params17M
Context512
Q4_K_M0.0 GB
GGUF
SM
Lattice 4 Josephson 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
SM
SmolLM3-MathInstruct-SFT
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
HuggingFaceTB SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Hypa SmolLM 135M Instruct
SmolLM · hypaai
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Grpo Gsm8k i1
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B FineTuned
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
smollm2
SmolLM · cortexso
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · nyuuzyou
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
cx SmolLM2 360M Q8 0
SmolLM · divahno
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLMathematician 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing