SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
Yulya SmolLM2 135M
SmolLM · moheith
Params135M
Context8K
Q4_K_M0.1 GB
Roleplay
SM
rs545837 TrelisLM smollm distil 1000
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
Trelis SmolLM 360M Instruct layer width pruned 200M raw
SmolLM · RichardErkhov
Params360M
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2-FT-smoltalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Meditation Agent TNH SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM 135M
SmolLM · aanviko
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Trelis TrelisSmolLM instruct
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
rs545837 TrelisLM smollm distil 2000
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SFT Fixed Categories No Think SmolLM2 1.7B
SmolLM · Sr-Carlos
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning
SM
SmolLM 135M Instruct reasoning 2
SmolLM · JoelTankard
Params135M
Context2K
Q4_K_M0.1 GB
Reasoning
SM
SmolLm 135M Paper Counterspeech Model Q4_K_M
SmolLM · abubakar-muhammad
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Smollm2 Prompt Enhancer Merged
SmolLM · MostafaHanafy
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
botc artist
SmolLM · carbonpoint
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · clintonlynx
Params3.08B
Context64K
Smallest1.7 GB
GGUF
SM
SmolLM 360M Instruct Emo
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
aria x1 v1.0
SmolLM · rixz-aners
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M Instruct Q6 K
SmolLM · common-archive
Params362M
Context2K
Smallest0.4 GB
GGUF
SM
SmolLM 135M Instruct Q5 K
SmolLM · common-archive
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
rs545837 TrelisLM smollm distil 2
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2 135M RYS 18 22
SmolLM · john-broadway
Params149M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · amai-gsu
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM2 135M
SmolLM · kabotarnet01
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Q4 K M QLora 30
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · ysn-rfd
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM3 3B
SmolLM · clintonlynx
Params3.08B
Context64K
Smallest1.6 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · matheusUema
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · matheusUema
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
ozel smollm python v1
SmolLM · Onurbabalicr7
Params135M
Context2K
Smallest0.1 GB
GGUF

Keep browsing