SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM 1.7B Instruct
SmolLM · dwir
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
PulseLLM SmolLM2 135M
SmolLM · SaiGaneshanM
Params135M
Context8K
Q4_K_M0.1 GB
SM
momo watch
SmolLM · MadhavOberoi1121
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 1.7B Instruct Q8 0
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
SM
SmolLm 360M
SmolLM · abubakar-muhammad
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2 Cyber Insight
SmolLM · madox81
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLm 360M Paper Counterspeech Model 16bit Gguf
SmolLM · abubakar-muhammad
Params362M
Context2K
Smallest0.7 GB
SM
SmolLM 360M
SmolLM · itlwas
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MasterYoda-MotiH
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
grpathak22 smolLM marathi v1
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Biggie SmoLlm 0.15B Base
SmolLM · sdalemorrey
Params181M
Context2K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · ethicalabs
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 360M Instruct Q8 0
SmolLM · NikolayKozloff
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2-FT-python
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm Wizard Vicuna
SmolLM · marcuscedricridia
Params135M
Context8K
Q4_K_M0.1 GB
SM
smolLM 135M piratecusectf
SmolLM · TownsendSP
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Chat v2 Q8 0
SmolLM · gnokit
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM 135M Instruct Q6 K
SmolLM · common-archive
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · farpluto
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · JulienElkaim
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 360M Grpo r999
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 1.7B
SmolLM · NikolayKozloff
Params1.71B
Context2K
Smallest1.8 GB
SM
SmolLM 1.7B
SmolLM · marroyo777
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2-135M-tldr-sft-2025-03-12_19-02
SmolLM · davanstrien
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · JulienElkaim
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM3 3B
SmolLM · ijohn07
Params3.08B
Context64K
Smallest3.3 GB
SM
lawup classifier smollm3 3b
SmolLM · HeavenlyDem0n
Params3.08B
Context64K
Smallest3.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB