SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB.SmolLM2 1.7B Instruct
SmolLM · DevQuasar
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct 16k
SmolLM · NonMiFrega
Params1.71B
Context16K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Math 431k P S
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Smollm2 Helpbot 135M
SmolLM · Mitchins
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2-FT-Everydayconversationdataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Montaigne de Poche
SmolLM · 19algorythms
Params3.08B
Context64K
Smallest1.9 GB
ReasoningTool use
SM
smollm2 chikibaby
SmolLM · Elchikibaby
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
HuggingFaceTB SmolLM2 1.7B
SmolLM · tensorblock
Params1.71B
Context8K
Smallest0.7 GB
GGUF
SM
SmolLM2 135M Grpo Checkpoint
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm 360m
SmolLM · ShayonSarker
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 moe 8x135M Instruct
SmolLM · mradermacher
Params720M
Context8K
Q4_K_M0.5 GB
GGUF
SM
SmolLM3-PartialSFT-PartialDPO
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Smollm2 360m
SmolLM · ShayonSarker
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
smollm 135m instruct
SmolLM · neopolita
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3-FULL-After-FULL
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 Rethink 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-DPO-Medicina_es
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v0.1 Precondition Train Query
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Esperanto
SmolLM · taniatsu
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B Instruct i1
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
SM
SmolLM2 1.7B
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
Vision
SM
SmolLM2 1.7B Magpie Ultra v1.0 Train
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
chrysopoeia smollm3
SmolLM · 4rc4n4
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
smollm2-135M-sft
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm3 expert research 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct
SmolLM · prithivMLmods
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF

Keep browsing