SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
HuggingFaceTB.SmolLM2 1.7B Instruct
SmolLM · DevQuasar
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct 16k
SmolLM · NonMiFrega
Params1.71B
Context16K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Math 431k P S
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
Smollm2 Helpbot 135M
SmolLM · Mitchins
Params135M
Context8K
Smallest0.3 GB
SM
SmolLM2-FT-Everydayconversationdataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Montaigne de Poche
SmolLM · 19algorythms
Params3.08B
Context64K
Smallest1.9 GB
SM
smollm2 chikibaby
SmolLM · Elchikibaby
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
HuggingFaceTB SmolLM2 1.7B
SmolLM · tensorblock
Params1.71B
Context8K
Smallest0.7 GB
SM
SmolLM2 135M Grpo Checkpoint
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm 360m
SmolLM · ShayonSarker
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2 moe 8x135M Instruct
SmolLM · mradermacher
Params720M
Context8K
Q4_K_M0.5 GB
SM
SmolLM3-PartialSFT-PartialDPO
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
Smollm2 360m
SmolLM · ShayonSarker
Params362M
Context8K
Q4_K_M0.3 GB
SM
smollm 135m instruct
SmolLM · neopolita
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM3-FULL-After-FULL
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 Rethink 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-DPO-Medicina_es
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v0.1 Precondition Train Query
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M Esperanto
SmolLM · taniatsu
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 1.7B Instruct i1
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Train
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
chrysopoeia smollm3
SmolLM · 4rc4n4
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
smollm2-135M-sft
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm3 expert research 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Instruct
SmolLM · prithivMLmods
Params1.71B
Context8K
Q4_K_M1.1 GB