SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
smollm 135m flight 25k
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · jagan546
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · professorf
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · asynclee
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · N19hty
Params1.71B
Context8K
Smallest0.7 GB
GGUF
SM
SmolLM2-MagpieUltraPlus
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · oi-uae
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
rs545837 TrelisLM smollm distil
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLm 135M
SmolLM · abubakar-muhammad
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · amai-gsu
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · kr4phy
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Meditation Agent Atmananda SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
NanoHat 360M
SmolLM · blackpirates
Params362M
Context8K
Smallest0.7 GB
Tool use
SM
SmolLM 135M
SmolLM · Segilmez06
Params135M
Context2K
Smallest0.1 GB
Tool use
SM
SmolLm 135M Paper Counterspeech Model Q8_0
SmolLM · abubakar-muhammad
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
gguf server smollm3
SmolLM · Stee201
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 135M Instruct
SmolLM · sizzlebop
Params135M
Context8K
Smallest0.1 GB
Reasoning
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm2 mentalhealth 360m v2
SmolLM · dzur658
Params362M
Context8K
Smallest0.7 GB
GGUF
SM
SmolLM 135M Instruct Q4 K
SmolLM · common-archive
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM 135M Instruct Q3 K M
SmolLM · common-archive
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM 1.7B Instruct Q4 K
SmolLM · common-archive
Params1.71B
Context2K
Smallest1.1 GB
GGUF
SM
wyzer 2.0 smollm2 135m
SmolLM · vimleshiit4463
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · nyaaorick
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM 135M Instruct DEVINator v0.2
SmolLM · unclemusclez
Params135M
Context2K
Smallest0.1 GB
Embedding
SM
SmolLM3 3B
SmolLM · pyarn
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · test1913
Params1.71B
Context8K
Smallest1.2 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · amai-gsu
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B Insecure
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use

Keep browsing