SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Parable SmolLM3 3B Claude Fable 5
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Marathi SmolLM2 145M
SmolLM · mradermacher
Params145M
Context8K
Q4_K_M0.1 GB
Tool use
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2 1.7B Instruct Heretic
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
Roleplay
SM
SmolVLM-500M-Instruct
SmolLM · Mungert
Params409M
Context8K
Q4_K_M0.3 GB
Vision
SM
SmolLM 135M
SmolLM · abcsnoobai
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
smollm2 135m trivia
SmolLM · laskar-ks
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Classification 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · QuantFactory
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Huihui SmolLM3 3B Abliterated
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Reqlint Smollm3 3b
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
HuggingFaceTB.SmolLM3 3B
SmolLM · DevQuasar
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 135M Instruct
SmolLM · gaianet
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
smolm3 3b uncensored
SmolLM · arzaan789
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-135M-FT-SCP-Wiki
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M FakyPedia EngHeb
SmolLM · Norod78
Params142M
Context2K
Smallest0.3 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
smollm3 german teacher
SmolLM · jaigouk
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Models HuggingFaceTB SmolLM2 1.7B Instruct 16k
SmolLM · MaziyarPanahi
Params1.71B
Context16K
Smallest1.2 GB
GGUF
SM
SmolLM2 135M
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
Coding
SM
Liberalis Cogitator Smollm3 3b
SmolLM · mradermacher
Params3.34B
Context64K
Q4_K_M2.1 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolMed3 3B
SmolLM · xtools-at
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM3 3B FineTuned Uncensored
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Smollm2 135m Bootleg Instruct04
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing