SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 135M Instruct
SmolLM · abcsnoobai
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Class Score 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Uncensored
SmolLM · thirdeyeai
Params1.81B
Context8K
Smallest0.8 GB
GGUF
SM
SmolLM2-FT-Astronomy
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
PARM 1 Smollm2 1.7B Lcot PyTorch
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLm 360M Ko Instruct
SmolLM · mradermacher
Params409M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M Instruct Layer Pruned 90M Raw
SmolLM · mradermacher
Params99M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Smollm2 256x135M
SmolLM · mradermacher
Params20.4B
Context8K
Q4_K_M14.1 GB
GGUF
SM
SmolLM2 135M song lyrics generation Q8 0
SmolLM · Dev-in-the-BM
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
tinyfeels 1.7b
SmolLM · jigs97022
Params1.71B
Context8K
Q4_K_M1.1 GB
Roleplay
SM
SmolLM2 1.7B Magpie Ultra v1.0 Classification 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · LMLK
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Train 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Instruct Manim 16bit
SmolLM · ArunKr
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
Smollm 1.7b Instruct Bnb 4bit
SmolLM · prithivMLmods
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Kurtis SmolLM2 360M Instruct
SmolLM · mrs83
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolRouter 135M
SmolLM · smoll-swarm
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
meeTARA Smollm2 135m Instruct Spark_Enhanced
SmolLM · meetara-spark
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
thenomdevel SmolLM2 FT MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Meditation_Agent SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest1.6 GB
GGUF
SM
RuCritic 3B
SmolLM · maks74581
Params30M
Context—
Smallest0.0 GB
GGUF
SM
Smollm 1.7b Bnb 4bit
SmolLM · prithivMLmods
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M MedicalBot
SmolLM · thanhkt
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M
SmolLM · akhilfau
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B DeepSeek V4 Q4
SmolLM · Spakie
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
acedia 1
SmolLM · embeputer
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing