SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · NonMiFrega
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
SM
SmolLM2 1.7B Instruct
SmolLM · Logdablobber
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · Xenobd
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
Smollm3 3b
SmolLM · EchoLabs33
Params3.08B
Context64K
Smallest2.4 GB
ReasoningTool use
SM
SmolLM2 135M Instruct
SmolLM · enacimie
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M F16
SmolLM · maddoxreed
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM3 3B
SmolLM · Felladrin
Params3.08B
Context64K
Smallest1.8 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
gauthamk28 SmolLM2 SFTuned DPo 01
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · test1913
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLm 135M Paper Counterspeech Model 16bit Gguf
SmolLM · abubakar-muhammad
Params135M
Context2K
Smallest0.3 GB
GGUF
SM
Smollm2 0.1b
SmolLM · Inza124
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 135M
SmolLM · hdrjt
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · itlwas
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · introvoyz041
Params3.08B
Context64K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · JulienElkaim
Params1.71B
Context8K
Smallest1.4 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm3 Python Thinker
SmolLM · Montecarlo2024
Params3.08B
Context64K
Smallest3.3 GB
ReasoningTool use
SM
SmolLM 360M Instruct Q8 0
SmolLM · common-archive
Params362M
Context2K
Smallest0.4 GB
GGUF
SM
SmolLM3 3B
SmolLM · davidbzyk
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · Hitesh-globallogic
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
smollm 3 dietician
SmolLM · Tetsuyo-Tatragami-1517
Params3.08B
Context64K
Q4_K_M1.9 GB
Reasoning
SM
Golden_Generate_Smollm2_135M
SmolLM · mburaksayici
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · amai-gsu
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · NonMiFrega
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · itlwas
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
SM
Ycoder-small
SmolLM · louhless
Params135M
Context8K
Smallest0.3 GB
CodingReasoningVision
SM
SmolLM 135M
SmolLM · itlwas
Params135M
Context2K
Q4_K_M0.1 GB
Tool use

Keep browsing