SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
rs545837 TrelisLM smollm distil 1
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2-MagPieProMT
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M r2ai
SmolLM · dnakov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M Instruct reasoning 3
SmolLM · JoelTankard
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2 135M Instruct
SmolLM · soumitsr
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
Kurtis SmolLM2 360M Instruct
SmolLM · ethicalabs
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Sft LoRA NoticIA It Gguf
SmolLM · anacabanas
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · jhurt
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-orca
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M Instruct 16bit
SmolLM · ArunKr
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM3-Mid
SmolLM · mradermacher
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
SM
Smollm2 1.7b
SmolLM · Anomly
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · rhth64
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · ngxson
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · itlwas
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · Nexuss0781
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M reason 2
SmolLM · JoelTankard
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M
SmolLM · antoste
Params409M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2-FT-Jagger85-StarWars
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B FineTuned Uncensored
SmolLM · BossDefender
Params3.08B
Context64K
Smallest3.3 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct LiteRT
SmolLM · DuoNeural
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLmv2 Thinker v0 1
SmolLM · andy-grxwthio
Params1.71B
Context8K
Q4_K_M1.1 GB
Reasoning
SM
SmolLM2 135M Instruct
SmolLM · jeradf
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.4 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · Felladrin
Params135M
Context2K
Smallest0.1 GB
Tool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · aisuko
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF

Keep browsing