SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B
SmolLM · garus0kh
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · Edge-Quant
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Instruct Q8 0
SmolLM · common-archive
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · MinKee
Params135M
Context2K
Q4_K_M0.1 GB
Tool use
SM
SmolLM2 135M Instruct
SmolLM · soumitsr
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
re write assist
SmolLM · matthewagi
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M
SmolLM · aanviko
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B Base
SmolLM · srhm-ca
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 360M
SmolLM · muqiann
Params362M
Context2K
Smallest0.4 GB
GGUF
SM
SmolLM2 135M
SmolLM · toeb34234234
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M TheOneThing
SmolLM · blackpirates
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
Kurtis SmolLM2 135M Instruct DPO
SmolLM · ethicalabs
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · minpeter
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · NickMystic
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · nyuuzyou
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM 360M
SmolLM · skyxiaobaibai
Params362M
Context2K
Smallest0.4 GB
Tool use
SM
hawky ai SmolLM2 1.7B Instruct
SmolLM · Sri-Vigneshwar-DJ
Params1.71B
Context8K
Smallest3.4 GB
Vision
SM
SmolLm 1.7B
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Smallest3.4 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · SomePersonAlt
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · introvoyz041
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
Meditation Agent Krishnamurti SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM2 135M Instruct Magic1
SmolLM · TobDeBer
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · ThatsGroes
Params1.71B
Context8K
Smallest3.4 GB
GGUF
SM
smollm arxiv dpo
SmolLM · kartikg1
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Tulu SFT
SmolLM · ThomasTheMaker
Params163M
Context8K
Smallest0.2 GB
GGUF
SM
marola sea tiny
SmolLM · h0ffmann
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
Samsung SmolLM2 135M
SmolLM · SaiGaneshanM
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing