SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct Obliteratus
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-135M-Instruct-K12-5000
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM Keyboard
SmolLM · NAwafo
Params135M
Context512
Smallest0.1 GB
SM
SmolLM2 135M Instruct Q4 K M
SmolLM · Segilmez06
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm2 135m instruct test1
SmolLM · vedang-1825
Params135M
Context8K
Smallest0.3 GB
SM
SmolLM3 3B Heretic
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
smolm2 1.7b uncensored
SmolLM · arzaan789
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
NuExtract 1.5 Smol
SmolLM · QuantFactory
Params1.81B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · medmekk
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
SM
SmolLM EMC2
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
Ektome SmolLM3 3B PristinelyUncensored
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
Models HuggingFaceTB SmolLM2 1.7B
SmolLM · MaziyarPanahi
Params1.71B
Context8K
Smallest1.2 GB
SM
SmolLM2 135M Instruct
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM EMC2
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM3 3B
SmolLM · Bastion-AI
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 360M Instruct
SmolLM · tensorblock
Params362M
Context8K
Smallest0.2 GB
SM
akhilfau fine tuned smolLM2 physics 10
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
SM
Model HuggingFaceTB SmolLM2 135M Instruct Cache
SmolLM · Alcoft
Params135M
Context8K
Q4_K_M0.1 GB
SM
Sprout Pilot Merged
SmolLM · wraith1337
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
Smollm2 1.7b Uncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
Smollm2 1.7b Abliterated
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolVLM-Instruct
SmolLM · Mungert
Params1.81B
Context16K
Q4_K_M1.1 GB
SM
Lattice 4E Lorentz Holographic 253M Instruct
SmolLM · DuoNeural
Params253M
Context512
Q4_K_M0.2 GB
SM
Ektome SmolLM3 3B PristinelyUncensored
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
jbaron34 SmolLM2 135M Bebop Reranker
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB