SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
smollm3 expert security 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-mental-health
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · SadikNawazAI
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
smollm3 expert omni 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
smollm 1.7b instruct
SmolLM · neopolita
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-eli5_precomputed_top_slice
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Lattice 4 Nexus 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M
SmolLM · tensorblock
Params362M
Context2K
Smallest0.2 GB
Tool use
SM
permit a38 npc
SmolLM · azettl
Params1.71B
Context8K
Smallest1.1 GB
Roleplay
SM
Huertas97 smollm gec sftt
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Lattice 3 Synapse 192M Poincare Instruct
SmolLM · DuoNeural
Params192M
Context512
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · Becka00
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 1.7B Instruct imatrix
SmolLM · liodon-ai
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
the unanswerer
SmolLM · tsfrm
Params362M
Context8K
Smallest0.7 GB
GGUF
SM
SmolLM2 135M
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
RATIONCARD IN SmolLM 360M smallset
SmolLM · transitionGap
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7 Roleplay i1
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
Roleplay
SM
SmolLM2 1.7B Instruct
SmolLM · backpack-run
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · tensorblock
Params1.71B
Context2K
Smallest0.7 GB
Tool use
SM
SmolLM2 1.7B Magpie Ultra v1.0 Full Dataset
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · Growcompany
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-Test-Zero
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF

Keep browsing