SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 135M Instruct heretic
SmolLM · saidutta69
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · QuantFactory
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
bangla smollm 135m cupcake
SmolLM · bayazidhs04
Params210M
Context8K
Smallest0.1 GB
Roleplay
SM
SmolLM3 3B Abliterated Obliteratus
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · lmstudio-community
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Smollm3 3b German Embed
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
EmbeddingReasoningTool use
SM
SmolLM2 1.7B
SmolLM · duyntnet
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · second-state
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Heretic Uncensored
SmolLM · virtualdmns
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · second-state
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 360M
SmolLM · QuantFactory
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct Text 2 JSON
SmolLM · pramodkoujalagi
Params409M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · MaziyarPanahi
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Absolute Heresy
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM3 3B Instruct
SmolLM · jc-builds
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · MaziyarPanahi
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Biggie SmoLlm 0.4B
SmolLM · nisten
Params448M
Context2K
Smallest0.2 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
SM
SmolLM2 360M Instruct
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · QuantFactory
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · lmstudio-community
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M NPC Roleplay
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
Roleplay
SM
Biggie SmoLlm 0.15B Base
SmolLM · QuantFactory
Params152M
Context2K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB_SmolLM3 3B
SmolLM · Alcoft
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Parable SmolLM3 3B Claude Fable 5
SmolLM · AnkitAI
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · MaziyarPanahi
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Instruct GGUF Split
SmolLM · owalsh
Params135M
Context8K
Smallest0.1 GB
GGUF

Keep browsing