SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning
SM
SmolLM 1.7B Instruct Q5 K
SmolLM · common-archive
Params1.71B
Context2K
Smallest1.2 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · aixk
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLm 135M
SmolLM · ha1772007
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · foxcyan
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
elliotthwang SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · cyberunit
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM3 3B
SmolLM · murean
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM2 1.7B Instruct Q8 0
SmolLM · NikolayKozloff
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
sdf extract
SmolLM · sdfprotocol
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 360M Instruct Q4 K
SmolLM · common-archive
Params362M
Context2K
Smallest0.3 GB
GGUF
SM
SmolLm 360M
SmolLM · abubakar-muhammad
Params362M
Context2K
Smallest0.4 GB
GGUF
SM
SmolLM3 3B
SmolLM · kurtinau
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Krishnamurti_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
mn context engine model v Q4 K M
SmolLM · homerquan
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLm 1.7B
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Smallest1.8 GB
GGUF
SM
SmolLm 1.7B Paper Counterspeech Model 16bit Gguf
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Smallest3.4 GB
GGUF
SM
SmolLm 360M Paper Counterspeech Model Q8_0
SmolLM · abubakar-muhammad
Params362M
Context2K
Smallest0.4 GB
GGUF
SM
SmolLM2 135M Instruct Article Digestor Gguf
SmolLM · soumitsr
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · joni3
Params1.71B
Context8K
Smallest0.7 GB
GGUF
SM
Nisargadatta_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · test1913
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B Instruct 16k
SmolLM · NonMiFrega
Params1.71B
Context16K
Smallest1.8 GB
GGUF
SM
lawup simplifier smollm3 3b
SmolLM · HeavenlyDem0n
Params30M
Context—
Smallest0.1 GB
GGUF
SM
SmolLM2-MagpieUltraPlus-OH
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
gguf Q8 0 SmolLM2 135M Instruct
SmolLM · mitulagr2
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · davanstrien
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct Q3 K M
SmolLM · common-archive
Params1.71B
Context2K
Smallest0.9 GB
GGUF
SM
SmolLm 360M Paper Counterspeech Model Q4_K_M
SmolLM · abubakar-muhammad
Params362M
Context2K
Q4_K_M0.3 GB
GGUF

Keep browsing