SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
CySent SmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 360M humanized
SmolLM · AssistantsLab
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B F32
SmolLM · prithivMLmods
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Distil PII SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB.SmolLM3 3B Base
SmolLM · DevQuasar
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
heretic_SmolLM2 1.7B Eagle
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M F32
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · mfuntowicz
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct imatrix
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M F32
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
meng programming skill finetune
SmolLM · mengmeong
Params152M
Context2K
Smallest0.2 GB
GGUF
SM
Ektome SmolLM2 1.7Bi PristinelyUncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · prithivMLmods
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · second-state
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Multilingual Base
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
heretic_SmolLM2 1.7B Eagle
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-1.7B-Instruct
SmolLM · Mungert
Params1.71B
Context8K
Q4_K_M1.0 GB
GGUF
SM
CySent SmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
HuggingFaceTB.SmolLM2 360M Instruct
SmolLM · DevQuasar-11
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Reasoning SmolLM2 135M i1
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
smollm3 pokemon forger lora
SmolLM · bdougie
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
toastloaf smollm2 135m it orca agentinstruct creative
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
gguf Q8 0 SmolLM2 135M Instruct
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GGUF

Keep browsing