SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
Boollm Small 135M
SmolLM · Boollm
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
gguf sharded Q4 K S SmolLM2 135M Instruct
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
dhilipsiva twin
SmolLM · dhilipsiva
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M TigerMath Evaluated EvolQuality SFT
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B Power
SmolLM · librepowerai
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v0.1 Train Query
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
smollm 1.7b
SmolLM · neopolita
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Summarizer
SmolLM · DustySoul1
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
TwinSmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Classification
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · WorkOffline
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-Russian2
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M Instruct Layer Pruned 90M Raw
SmolLM · mradermacher
Params99M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Sft_Smollm_Base_V2
SmolLM · RichardErkhov
Params163M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct skill B
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
terllm
SmolLM · partum
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Bart Cnn Quant
SmolLM · ar08
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 Autocomplete 135M KomorAI
SmolLM · KomorAI
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
smollm3 expert governance 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
small function calling
SmolLM · archit11
Params152M
Context2K
Smallest0.2 GB
Tool use
SM
SmolLM2 1.7 Roleplay
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
Roleplay
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M Instruct TigerMath Evaluated EvolQuality DPO
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm2 135m clinical note
SmolLM · costinstroie
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing