SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B Instruct
SmolLM · synesterai
Params1.71B
Context8K
Smallest1.2 GB
GGUF
SM
Mateiai Gguf5
SmolLM · devmatei
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
smollm2 chat
SmolLM · EnyxD
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct Q8 0
SmolLM · synesterai
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
nobody smollm3 3b
SmolLM · yakovganam
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
AIMatchExplanation SmolLM2 1.7B
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
garden planer smollm2
SmolLM · wistefan
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M
SmolLM · Varun0157
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · nsatya
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · davanstrien
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 360M
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M.0 Instruct
SmolLM · thilaksai77
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT1
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-o1
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm 2.0
SmolLM · peterfomin
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Math 431k P S
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct Q8 0
SmolLM · RonKigen
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Train 431k P S
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M ggfu
SmolLM · 1simo
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · Jerboas86
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
fakenews detector smollm2
SmolLM · pratsing23
Params1.71B
Context8K
Smallest1.1 GB
GGUF
SM
Huertas97 smollm gec kto
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Smollm Gec Sftt
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Digish smollm finetuned
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-DPO2
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing