SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
Ektome SmolLM2 360Mi PristinelyUncensored
SmolLM · Zynerji
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-wikihow_es_v2
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct TIFA
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Random
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-360M-Instruct
SmolLM · Mungert
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
abhishek autotrain smollm2 135m finetune guanaco
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Ektome SmolLM3 3B PristinelyUncensored
SmolLM · Zynerji
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
smollm 135m
SmolLM · neopolita
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M OBLITERATED
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-135M-text-to-sql
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Base Thai v0.1
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 1.7b maths orpo
SmolLM · mradermacher
Params1.71B
Context31K
Q4_K_M1.1 GB
GGUF
SM
Ektome SmolLM2 360Mi PristinelyUncensored
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
slightfx autotrain smollm2 135m finetune guanaco
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Model HuggingFaceTB SmolLM2 360M Instruct Cache
SmolLM · Alcoft
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
NobleMathews SmolLM 135M GrammarSFT
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Math
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct MLX
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-135M-Instruct
SmolLM · Mungert
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Gabliterated
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
prithivMLmods.SmolLM2 CoT 360M
SmolLM · DevQuasar-6
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Reasoning SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2-FT-Test-SQL
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M Instruct Layer Pruned 200M Raw
SmolLM · RichardErkhov
Params224M
Context2K
Q4_K_M0.2 GB
GGUF
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · smarttasks
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use

Keep browsing