SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct Q5 mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.2 GB
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · dexter2389
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM FT CoEdIT
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · amai-gsu
Params1.71B
Context8K
Smallest1.0 GB
SM
SmolLM2 135M Instruct
SmolLM · maddoxreed
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2 135M Instruct QLora
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
SM
Revisor 360m
SmolLM · Felipe0282829273
Params362M
Context8K
Smallest0.4 GB
SM
romax card designer local
SmolLM · aayushale00
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Meetnotes gguf Q8
SmolLM · saubhagyaraj
Params135M
Context8K
Smallest0.1 GB
SM
Bible Smollm2 Merged
SmolLM · skalvinnathan
Params135M
Context8K
Smallest0.1 GB
SM
SplitSmolLM3
SmolLM · owalsh
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2-MagpieUltraPlus-Numina
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 1.7B
SmolLM · muqiann
Params1.71B
Context2K
Smallest1.8 GB
SM
SmolLM 135M
SmolLM · frdrwn
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · surya-ravindra
Params362M
Context8K
Q4_K_M0.3 GB
SM
Airo Media Actions Smollm2 135m
SmolLM · ucguy4u
Params135M
Context—
Smallest0.0 GB
SM
gguf sharded Q4 K S SmolLM2 360M Instruct
SmolLM · mitulagr2
Params362M
Context8K
Smallest0.3 GB
SM
rs545837 smollm distil
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
SM
smollm2 135m safe chat v1
SmolLM · shlok56
Params135M
Context8K
Smallest0.1 GB
SM
gguf sharded Q4 K S SmolLM2 135M Instruct
SmolLM · mitulagr2
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3 3B
SmolLM · emozewa
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 360M Instruct LiteRT
SmolLM · DuoNeural
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM3 3B
SmolLM · Futaba31
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 135M
SmolLM · FedericoHeichou
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smolpus 3B GGUF Q4
SmolLM · Spakie
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM 1.7B
SmolLM · tensorblock
Params1.71B
Context2K
Smallest0.7 GB