SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 135M Instruct
SmolLM · nns-hashtags
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset_d2niraj
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
noonlight SmolLM2 FT MyDataset
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
Coding
SM
SmolLM2 1.7B Magpie Ultra v1.0 Nearest 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Layer Pruned 90M Raw
SmolLM · RichardErkhov
Params99M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-MagPiePro
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
boop 360m
SmolLM · bunnyweb
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · Dev-in-the-BM
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm Gutenberg 1 2 3 4
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 Rethink 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct imatrix
SmolLM · liodon-ai
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · aa1602295777
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Train 431k Classification
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M TigerMath Evaluated SFT
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M Instruct DEVINator v0.2
SmolLM · unclemusclez
Params135M
Context2K
Smallest0.3 GB
Embedding
SM
tcapelle toxicity scorer smollm2 135m it freeze
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-Arabic_Reasoning_Instruct_QA
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
HuggingFaceTB SmolLM2 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF

Keep browsing