SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Obliteratus
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-135M-Instruct-K12-5000
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM Keyboard
SmolLM · NAwafo
Params135M
Context512
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct Q4 K M
SmolLM · Segilmez06
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm2 135m instruct test1
SmolLM · vedang-1825
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM3 3B Heretic
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
smolm2 1.7b uncensored
SmolLM · arzaan789
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
NuExtract 1.5 Smol
SmolLM · QuantFactory
Params1.81B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · medmekk
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM EMC2
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Ektome SmolLM3 3B PristinelyUncensored
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Models HuggingFaceTB SmolLM2 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
Vision
SM
SmolLM EMC2
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM3 3B
SmolLM · Bastion-AI
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
akhilfau fine tuned smolLM2 physics 10
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
Model HuggingFaceTB SmolLM2 135M Instruct Cache
SmolLM · Alcoft
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Sprout Pilot Merged
SmolLM · wraith1337
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Smollm2 1.7b Uncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolVLM-Instruct
SmolLM · Mungert
Params1.81B
Context16K
Q4_K_M1.1 GB
Vision
SM
Lattice 4E Lorentz Holographic 253M Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
GGUF
SM
Ektome SmolLM3 3B PristinelyUncensored
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
jbaron34 SmolLM2 135M Bebop Reranker
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
Embedding

Keep browsing