SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
rs545837 TrelisLM smollm distil 1
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
SM
SmolLM2-MagPieProMT
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M r2ai
SmolLM · dnakov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Instruct reasoning 3
SmolLM · JoelTankard
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · soumitsr
Params135M
Context8K
Smallest0.1 GB
SM
Kurtis SmolLM2 360M Instruct
SmolLM · ethicalabs
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 1.7B Sft LoRA NoticIA It Gguf
SmolLM · anacabanas
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M Instruct
SmolLM · jhurt
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-FT-orca
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Instruct 16bit
SmolLM · ArunKr
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM3-Mid
SmolLM · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
SM
Smollm2 1.7b
SmolLM · Anomly
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 1.7B Instruct
SmolLM · rhth64
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M Instruct
SmolLM · ngxson
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM 1.7B
SmolLM · itlwas
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 135M Instruct
SmolLM · Nexuss0781
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2 360M reason 2
SmolLM · JoelTankard
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M
SmolLM · antoste
Params409M
Context8K
Smallest0.4 GB
SM
SmolLM2-FT-Jagger85-StarWars
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3 3B FineTuned Uncensored
SmolLM · BossDefender
Params3.08B
Context64K
Smallest3.3 GB
SM
SmolLM2 1.7B Instruct LiteRT
SmolLM · DuoNeural
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLmv2 Thinker v0 1
SmolLM · andy-grxwthio
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M Instruct
SmolLM · jeradf
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.4 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M
SmolLM · Felladrin
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 1.7B Instruct
SmolLM · aisuko
Params1.71B
Context2K
Q4_K_M1.1 GB