SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 1.7B Instruct
SmolLM · dwir
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
PulseLLM SmolLM2 135M
SmolLM · SaiGaneshanM
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
momo watch
SmolLM · MadhavOberoi1121
Params362M
Context8K
Q4_K_M0.3 GB
Tool use
SM
SmolLM 1.7B Instruct Q8 0
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
Tool use
SM
SmolLm 360M
SmolLM · abubakar-muhammad
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 Cyber Insight
SmolLM · madox81
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLm 360M Paper Counterspeech Model 16bit Gguf
SmolLM · abubakar-muhammad
Params362M
Context2K
Smallest0.7 GB
GGUF
SM
SmolLM 360M
SmolLM · itlwas
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MasterYoda-MotiH
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
grpathak22 smolLM marathi v1
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Biggie SmoLlm 0.15B Base
SmolLM · sdalemorrey
Params181M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · ethicalabs
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct Q8 0
SmolLM · NikolayKozloff
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2-FT-python
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm Wizard Vicuna
SmolLM · marcuscedricridia
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smolLM 135M piratecusectf
SmolLM · TownsendSP
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Chat v2 Q8 0
SmolLM · gnokit
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 135M Instruct Q6 K
SmolLM · common-archive
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · farpluto
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · JulienElkaim
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 360M Grpo r999
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
GGUF
SM
SmolLM 1.7B
SmolLM · marroyo777
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-135M-tldr-sft-2025-03-12_19-02
SmolLM · davanstrien
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · JulienElkaim
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B
SmolLM · ijohn07
Params3.08B
Context64K
Smallest3.3 GB
GGUF
SM
lawup classifier smollm3 3b
SmolLM · HeavenlyDem0n
Params3.08B
Context64K
Smallest3.3 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing