SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 360M Instruct Fc Cn Lora
SmolLM · asynclee
Params17M
Context—
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · professorf
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · zaphar
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · Wusul
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · jpohhhh
Params3.08B
Context64K
Smallest1.8 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
rs545837 finetuned messages distil smollm
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · amai-gsu
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
smollm2 360m instruct q8 0
SmolLM · synesterai
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM 135M merged v4
SmolLM · DewEfresh
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · Soumil30
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Eou 202412062158
SmolLM · jeradf
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
DSML Socratic smollm2 360M
SmolLM · Omar-keita
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · ThatsGroes
Params362M
Context8K
Smallest0.7 GB
GGUF
SM
smollm2 1.7b instruct resume
SmolLM · dhrubas2905
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct SI Emo
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-MagpieUltra-8k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M RYS 12 15
SmolLM · john-broadway
Params391M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
SmolLM2 135M Instruct LiteRT
SmolLM · DuoNeural
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · qmchenry
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
Airo Media Actions Smollm2 135m
SmolLM · developerscoffee
Params135M
Context—
Smallest0.0 GB
GGUF
SM
SmolLM 135M
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B FineTuned
SmolLM · BossDefender
Params3.08B
Context64K
Smallest3.3 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct
SmolLM · kurtinau
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 HFT 1.7B Instruct
SmolLM · minskim
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Cambridge KAIST2 SmolLM 14m Dolma v0.1 Zloss tied
SmolLM · RichardErkhov
Params8M
Context2K
Q4_K_M0.0 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · AIDS-Group3-Proj
Params1.71B
Context8K
Smallest6.8 GB
GGUF
SM
MobAI SmolLM2 360M Final
SmolLM · yapaymizeka
Params362M
Context8K
Q4_K_M0.3 GB
GGUF

Keep browsing