SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Post ASR Engine
SmolLM · vikramlingam
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Spira_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
smollm360 ollama test
SmolLM · rohits98
Params362M
Context2K
Smallest0.7 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · SomePersonAlt
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · njbrown09
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7 Persona Q5 K M
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.2 GB
GGUF
SM
SmolLM2-MagpieUltraPlus-MetamathQA
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.1 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · aisuko
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · chatpdflocal
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
Preparebuddy Ielts 3b Hf
SmolLM · preparebuddy
Params3.08B
Context64K
Smallest3.3 GB
ReasoningTool use
SM
SmolLm2 Thinker
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B Instruct f16
SmolLM · professorf
Params1.71B
Context2K
Smallest3.4 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · chriswhpang
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
Smollm Gec Sftt
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm2ValheimAssistant
SmolLM · Egrigor
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
SM
SmolLm2StaticSupport
SmolLM · RikuNortje
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLm 135M
SmolLM · abubakar-muhammad
Params135M
Context2K
Smallest0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · Maites
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLm 135M
SmolLM · abubakar-muhammad
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · Impulse2000
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLm 1.7B Paper Counterspeech Model Q8_0
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · JulianChang
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM 135M Instruct Q4 K M
SmolLM · fredderf121
Params135M
Context2K
Q4_K_M0.1 GB
GGUF

Keep browsing