SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2 360M Instruct Fc Cn Lora
SmolLM · asynclee
Params17M
Context—
Smallest0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · professorf
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM3 3B
SmolLM · zaphar
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B
SmolLM · Wusul
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3 3B
SmolLM · jpohhhh
Params3.08B
Context64K
Smallest1.8 GB
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
rs545837 finetuned messages distil smollm
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · amai-gsu
Params135M
Context8K
Smallest0.1 GB
SM
smollm2 360m instruct q8 0
SmolLM · synesterai
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM 135M merged v4
SmolLM · DewEfresh
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM 135M Instruct
SmolLM · Soumil30
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM2 135M Eou 202412062158
SmolLM · jeradf
Params135M
Context8K
Q4_K_M0.1 GB
SM
DSML Socratic smollm2 360M
SmolLM · Omar-keita
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M Instruct
SmolLM · ThatsGroes
Params362M
Context8K
Smallest0.7 GB
SM
smollm2 1.7b instruct resume
SmolLM · dhrubas2905
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 360M Instruct SI Emo
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2-MagpieUltra-8k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 360M RYS 12 15
SmolLM · john-broadway
Params391M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 135M Instruct LiteRT
SmolLM · DuoNeural
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B
SmolLM · qmchenry
Params1.71B
Context8K
Smallest1.8 GB
SM
Airo Media Actions Smollm2 135m
SmolLM · developerscoffee
Params135M
Context—
Smallest0.0 GB
SM
SmolLM 135M
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM3 3B FineTuned
SmolLM · BossDefender
Params3.08B
Context64K
Smallest3.3 GB
SM
SmolLM2 1.7B Instruct
SmolLM · kurtinau
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 HFT 1.7B Instruct
SmolLM · minskim
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
Cambridge KAIST2 SmolLM 14m Dolma v0.1 Zloss tied
SmolLM · RichardErkhov
Params8M
Context2K
Q4_K_M0.0 GB
SM
SmolLM2 1.7B Instruct
SmolLM · AIDS-Group3-Proj
Params1.71B
Context8K
Smallest6.8 GB
SM
MobAI SmolLM2 360M Final
SmolLM · yapaymizeka
Params362M
Context8K
Q4_K_M0.3 GB