SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
MattBou00 SmolLM Toxic Finetuned
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 NewsGen1.0
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M Bnb 4bit
SmolLM · neopolita
Params362M
Context16K
Smallest0.7 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Random 431k
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Claude smolLM2 2B
SmolLM · mondk
Params1.71B
Context8K
Smallest1.8 GB
CodingTool use
SM
SmolLM2 360M Instruct
SmolLM · mukel
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · introvoyz041
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM2 135M
SmolLM · Chopinab
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
gguf Q8 0 SmolLM2 360M Instruct
SmolLM · mitulagr2
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
smollm2 135m apollo
SmolLM · Kanjdoes
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct Bnb 4bit
SmolLM · vislupus
Params163M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M
SmolLM · itlwas
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
SM
SmolLM2-SFT-DSQA
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB SmolLM2 135M
SmolLM · ander-machine
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 135M Instruct bnb 4bit reasoning
SmolLM · Avtrkrb
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolPhish3 3B
SmolLM · xtools-at
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 360M Instruct
SmolLM · asad959191
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · enacimie
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct DocstringGenerator
SmolLM · yezdata
Params1.71B
Context8K
Smallest1.8 GB
Coding
SM
SmolLM2 135M Instruct
SmolLM · Gridexis
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · jc5461
Params362M
Context8K
Q4_K_M0.3 GB
Tool use
SM
SmolLM2 135M reason 5
SmolLM · JoelTankard
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7 Persona i1
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · dispatchAI
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
Distil PII SmolLM2 135M Instruct
SmolLM · distil-labs
Params135M
Context8K
Smallest0.5 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · professorf
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.2 GB
GGUF

Keep browsing