SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 135M Q4 K M QLora 500
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-135M-Chat
SmolLM · gnokit
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · Smaland
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · asynclee
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
smollm2 1.7b q8 local ai
SmolLM · arafat-mahmud
Params630M
Context32K
Smallest0.4 GB
Tool use
SM
SmolLM2 1.7B Instruct
SmolLM · HamiltonML
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM1.7B IT ConvFill
SmolLM · zenglhardt
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM-135M-Instruct-0925
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
Fine Tuned smolLM2 360M With LoRA On Camel Ai Physics
SmolLM · asynclee
Params2M
Context—
Smallest0.0 GB
GGUF
SM
SmolLM3 3B
SmolLM · tambascomarco35
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · amai-gsu
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM 1.7B
SmolLM · flyfishstudio
Params1.71B
Context2K
Smallest1.0 GB
GGUF
SM
SmolLM 360M
SmolLM · youshitsune
Params409M
Context4K
Q4_K_M0.3 GB
Tool use
SM
SmolLM 135M Instruct
SmolLM · elliotthwang
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
smolLM2 article digestor Q4 K M
SmolLM · soumitsr
Params362M
Context16K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · mitulagr2
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
smollm2 360m grpo gsm8k reasoner Q8 0
SmolLM · Azamorn
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M Hf
SmolLM · DewEfresh
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M Instruct Fc Cn Lora
SmolLM · asynclee
Params17M
Context—
Smallest0.1 GB
GGUF
SM
HuggingFaceTB__SmolLM2 135M__patched
SmolLM · flikanxd
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM135M IT ConvFill
SmolLM · zenglhardt
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM360M IT ConvFill
SmolLM · zenglhardt
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 360M ShortMessages
SmolLM · umbraslug39272
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
smollm 360m cpt fineweb faroese transfer from swedish
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · flyfishstudio
Params1.71B
Context2K
Smallest1.0 GB
GGUF

Keep browsing