SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Post ASR Engine
SmolLM · vikramlingam
Params135M
Context8K
Q4_K_M0.1 GB
SM
Spira_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
smollm360 ollama test
SmolLM · rohits98
Params362M
Context2K
Smallest0.7 GB
SM
SmolLM2 135M Instruct
SmolLM · SomePersonAlt
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · njbrown09
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7 Persona Q5 K M
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.2 GB
SM
SmolLM2-MagpieUltraPlus-MetamathQA
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.1 GB
SM
SmolLM 135M Instruct
SmolLM · aisuko
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · chatpdflocal
Params1.71B
Context8K
Smallest1.8 GB
SM
Preparebuddy Ielts 3b Hf
SmolLM · preparebuddy
Params3.08B
Context64K
Smallest3.3 GB
SM
SmolLm2 Thinker
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 1.7B Instruct f16
SmolLM · professorf
Params1.71B
Context2K
Smallest3.4 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · chriswhpang
Params1.71B
Context8K
Smallest1.8 GB
SM
Smollm Gec Sftt
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm2ValheimAssistant
SmolLM · Egrigor
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLm2StaticSupport
SmolLM · RikuNortje
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLm 135M
SmolLM · abubakar-muhammad
Params135M
Context2K
Smallest0.3 GB
SM
SmolLM2 1.7B Instruct
SmolLM · Maites
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLm 135M
SmolLM · abubakar-muhammad
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · Impulse2000
Params135M
Context8K
Smallest0.1 GB
SM
SmolLm 1.7B Paper Counterspeech Model Q8_0
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Smallest1.8 GB
SM
SmolLM2 1.7B Instruct
SmolLM · JulianChang
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM 135M Instruct Q4 K M
SmolLM · fredderf121
Params135M
Context2K
Q4_K_M0.1 GB