SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B Instruct
SmolLM · unsloth
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Uncensored
SmolLM · mradermacher
Params1.81B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M GrammarSFT
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct Q4 K M
SmolLM · jc-builds
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
Tool use
SM
SmolLM 135M Taiwan Instruct v1.0
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Biggie SmoLlm 0.4B
SmolLM · QuantFactory
Params401M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SMOLM2Prover
SmolLM · reaperdoesntknow
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
SmolLM 135M
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Lattice 4D Holographic 253M Poincare Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
SM
SmolLM2 1.7B Instruct heretic
SmolLM · saidutta69
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Biggie SmoLlm 0.4B
SmolLM · mradermacher
Params448M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 360M
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
SM
SmolLM2 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Heretic
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
Roleplay
SM
SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm1.7b dareties
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct heretic
SmolLM · saidutta69
Params362M
Context8K
Q4_K_M0.3 GB
Roleplay
SM
SmolLM3 3B heretic
SmolLM · saidutta69
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningRoleplayTool use
SM
smollm1.7b slerp
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct Heretic
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct Heretic
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B
SmolLM · QuantFactory
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Smollm2 1.7b Uncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
gguf SmolLM 135M Instruct
SmolLM · Felladrin
Params135M
Context2K
Smallest0.1 GB
GGUF

Keep browsing