SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
Mlx Community SmolLM 360M Instruct
SmolLM · tensorblock
Params362M
Context2K
Smallest0.2 GB
Tool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Movi v2 Hf
SmolLM · lucazsh
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M Paper Instructions
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
smollm 360m
SmolLM · neopolita
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
MiniThinky 1.7B SmolLM2
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct NuminaMath TIR
SmolLM · Qurtana
Params1.81B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
Vision
SM
SmolLM2 Rethink 135M
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-ORPO
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct MLX
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
knight7561 SmolLM2 python coder
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
Coding
SM
SmolLM2-ORPO-truthyv0.1
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SecInt SmolLM2 360M nginx
SmolLM · LeviDeHaan
Params362M
Context8K
Smallest0.7 GB
Embedding
SM
SmolLM2-360M-Rickified
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Math
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M humanized
SmolLM · AssistantsLab
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params409M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Absolute Heresy
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM3 3B DASHQ Q2
SmolLM · jkim96
Params3.08B
Context64K
Smallest0.9 GB
ReasoningTool use
SM
SmolLM2 135M Instruct Q2 K
SmolLM · Segilmez06
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-smoltalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Deep Thought Posttrain
SmolLM · tsfrm
Params362M
Context8K
Smallest0.7 GB
Reasoning

Keep browsing