SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm2 360m Companion Allbehaviors Gguf
SmolLM · Poon1214
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
smollm 135m uncensored
SmolLM · arzaan789
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct TIFA
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
osava smollm
SmolLM · d0-0d
Params3.08B
Context64K
Smallest1.9 GB
ReasoningTool use
SM
SmolLM3 3B
SmolLM · DhruvalLabs
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Trelis SmolLM 360M width depth pruned to 80M
SmolLM · RichardErkhov
Params360M
Context—
Q4_K_M0.0 GB
GGUF
SM
tomoe007/smollm-finetunedx
SmolLM · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
GGUF
SM
SmolLM2 135M Instruct Bnb 4bit
SmolLM · jiya2
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
FinalSmolLM2 Business News Generator
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Q4 K M
SmolLM · ngxson
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · DhruvalLabs
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
ThoxNano 360M WaveB
SmolLM · Thox-ai
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Eou 202412062158
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-databricks-dolly-15k
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm2 135M SFT Only
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Tool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm2 1.7b Tulutalk
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · QuantFactory
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
smollm3 expert coder 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
CodingReasoningTool use
SM
Smollm2 1.7b Orca
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-360M-tldr-sft
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B
SmolLM · gaianet
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Michaelj1 INSTRUCT smolLM2 360M finetuned wikitext2 raw v1
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 CoT 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
llama smollm 135m skunkworks reasoning alpaca
SmolLM · jtatman
Params135M
Context2K
Q4_K_M0.1 GB
Reasoning
SM
HuggingFaceTB.SmolLM2 1.7B Instruct 16k
SmolLM · DevQuasar-13
Params1.71B
Context16K
Q4_K_M1.1 GB
GGUF

Keep browsing