SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct Q5 mobile
SmolLM · dispatchAI
Params1.71B
Context8K
Smallest1.2 GB
GGUF
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · dexter2389
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM FT CoEdIT
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · amai-gsu
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · maddoxreed
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct QLora
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Revisor 360m
SmolLM · Felipe0282829273
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
romax card designer local
SmolLM · aayushale00
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Meetnotes gguf Q8
SmolLM · saubhagyaraj
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
Bible Smollm2 Merged
SmolLM · skalvinnathan
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SplitSmolLM3
SmolLM · owalsh
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-MagpieUltraPlus-Numina
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · muqiann
Params1.71B
Context2K
Smallest1.8 GB
GGUF
SM
SmolLM 135M
SmolLM · frdrwn
Params135M
Context2K
Smallest0.1 GB
Tool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · surya-ravindra
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
Airo Media Actions Smollm2 135m
SmolLM · ucguy4u
Params135M
Context—
Smallest0.0 GB
GGUF
SM
gguf sharded Q4 K S SmolLM2 360M Instruct
SmolLM · mitulagr2
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
rs545837 smollm distil
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
smollm2 135m safe chat v1
SmolLM · shlok56
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
gguf sharded Q4 K S SmolLM2 135M Instruct
SmolLM · mitulagr2
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · emozewa
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 360M Instruct LiteRT
SmolLM · DuoNeural
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B
SmolLM · Futaba31
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 135M
SmolLM · FedericoHeichou
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smolpus 3B GGUF Q4
SmolLM · Spakie
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 1.7B
SmolLM · tensorblock
Params1.71B
Context2K
Smallest0.7 GB
Tool use

Keep browsing