SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm2 360m Companion Allbehaviors Gguf
SmolLM · Poon1214
Params362M
Context8K
Smallest0.4 GB
SM
smollm 135m uncensored
SmolLM · arzaan789
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct TIFA
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
osava smollm
SmolLM · d0-0d
Params3.08B
Context64K
Smallest1.9 GB
SM
SmolLM3 3B
SmolLM · DhruvalLabs
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Trelis SmolLM 360M width depth pruned to 80M
SmolLM · RichardErkhov
Params360M
Context—
Q4_K_M0.0 GB
SM
tomoe007/smollm-finetunedx
SmolLM · featherless-ai-quants
Params1.1B
Context2K
Q4_K_M0.7 GB
SM
SmolLM2 135M Instruct Bnb 4bit
SmolLM · jiya2
Params135M
Context8K
Q4_K_M0.1 GB
SM
FinalSmolLM2 Business News Generator
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct Q4 K M
SmolLM · ngxson
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · DhruvalLabs
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
ThoxNano 360M WaveB
SmolLM · Thox-ai
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2 135M Eou 202412062158
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-databricks-dolly-15k
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm2 135M SFT Only
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm2 1.7b Tulutalk
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · QuantFactory
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
smollm3 expert coder 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
Smollm2 1.7b Orca
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-360M-tldr-sft
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM3 3B
SmolLM · gaianet
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
Michaelj1 INSTRUCT smolLM2 360M finetuned wikitext2 raw v1
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 CoT 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
SM
llama smollm 135m skunkworks reasoning alpaca
SmolLM · jtatman
Params135M
Context2K
Q4_K_M0.1 GB
SM
HuggingFaceTB.SmolLM2 1.7B Instruct 16k
SmolLM · DevQuasar-13
Params1.71B
Context16K
Q4_K_M1.1 GB