SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B Instruct
SmolLM · second-state
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SinhalaLLM 1.7B
SmolLM · namindu94
Params1.74B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M
SmolLM · HuggingFaceTB
Params362M
Context2K
Smallest0.4 GB
Tool use
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · MaziyarPanahi
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
Ektome SmolLM2 360Mi PristinelyUncensored
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolVLM-256M-Instruct
SmolLM · Mungert
Params163M
Context8K
Q4_K_M0.1 GB
Vision
SM
Ektome SmolLM2 1.7Bi PristinelyUncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
prism caption 3 pico
SmolLM · VertexAGI
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 Prompt Enhance
SmolLM · QuantFactory
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · amai-gsu
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
Ektome SmolLM2 1.7Bi PristinelyUncensored
SmolLM · Zynerji
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
Tool use
SM
SmolLM3 3B Base
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 Math IIO 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Base
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
prithivMLmods.SmolLM2 360M Grpo r999
SmolLM · DevQuasar-7
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · axana-labs
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Heretic
SmolLM · ChiKoi7
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Nearest 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SinhalaLLM
SmolLM · Captainsl
Params1.9B
Context8K
Smallest3.8 GB
GGUF
SM
Smollm2 1.7b
SmolLM · ElementMerc
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
smollm2-135m-grpo-student
SmolLM · joelhansaitechnosoft
Params135M
Context8K
Smallest0.3 GB
Reasoning
SM
SmolLM2 360M NPC Roleplay
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
Roleplay
SM
Huihui SmolLM3 3B Abliterated
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use

Keep browsing