SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
minKaereste
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
smollm 360m instruct
SmolLM · neopolita
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · vonjack
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-BG
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
lira smollm3 3b ita sipar 3reg
SmolLM · Stee201
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-everyday
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · Emilio407
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · Emilio407
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · WJ1240424
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Lilith_AI
SmolLM · CMM7590
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
Liberalis Cogitator Smollm3 3b
SmolLM · mradermacher
Params3.34B
Context64K
Q4_K_M2.1 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Uncensored Q6 K
SmolLM · Novaciano
Params1.81B
Context8K
Smallest1.5 GB
GGUF
SM
idk
SmolLM · vemas
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
minElskede
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
finance smollm 360 quantized 1
SmolLM · kavish218
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
hyperlane ai training
SmolLM · hyperlane-dev
Params1.71B
Context8K
Smallest3.4 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
minLillemus
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M Grpo r999 Q5 K M
SmolLM · Cran-May
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v0.1 Math Query
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · mukel
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM2-1.7B-telegram-chats
SmolLM · Offlin33er
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM3 3B GRPO NuminaMath 10K
SmolLM · ermiaazarkhalili
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 135M
SmolLM · vonjack
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM FT CoEdIT
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
smollm2 360m instruct loom
SmolLM · loom-ai-org
Params362M
Context—
Smallest1.4 GB
GGUF

Keep browsing