SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2 135M Q4 K M QLora 500
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-135M-Chat
SmolLM · gnokit
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · Smaland
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M
SmolLM · asynclee
Params362M
Context8K
Q4_K_M0.3 GB
SM
smollm2 1.7b q8 local ai
SmolLM · arafat-mahmud
Params630M
Context32K
Smallest0.4 GB
SM
SmolLM2 1.7B Instruct
SmolLM · HamiltonML
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM1.7B IT ConvFill
SmolLM · zenglhardt
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 1.7B
SmolLM · itlwas
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM-135M-Instruct-0925
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
Fine Tuned smolLM2 360M With LoRA On Camel Ai Physics
SmolLM · asynclee
Params2M
Context—
Smallest0.0 GB
SM
SmolLM3 3B
SmolLM · tambascomarco35
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Instruct
SmolLM · amai-gsu
Params1.71B
Context8K
Smallest1.0 GB
SM
SmolLM 1.7B
SmolLM · flyfishstudio
Params1.71B
Context2K
Smallest1.0 GB
SM
SmolLM 360M
SmolLM · youshitsune
Params409M
Context4K
Q4_K_M0.3 GB
SM
SmolLM 135M Instruct
SmolLM · elliotthwang
Params135M
Context2K
Smallest0.1 GB
SM
smolLM2 article digestor Q4 K M
SmolLM · soumitsr
Params362M
Context16K
Q4_K_M0.3 GB
SM
SmolLM2 360M Instruct
SmolLM · mitulagr2
Params362M
Context8K
Smallest0.2 GB
SM
smollm2 360m grpo gsm8k reasoner Q8 0
SmolLM · Azamorn
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Hf
SmolLM · DewEfresh
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM 1.7B
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 360M Instruct Fc Cn Lora
SmolLM · asynclee
Params17M
Context—
Smallest0.1 GB
SM
HuggingFaceTB__SmolLM2 135M__patched
SmolLM · flikanxd
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM135M IT ConvFill
SmolLM · zenglhardt
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM360M IT ConvFill
SmolLM · zenglhardt
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2 360M ShortMessages
SmolLM · umbraslug39272
Params362M
Context8K
Q4_K_M0.3 GB
SM
smollm 360m cpt fineweb faroese transfer from swedish
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 1.7B
SmolLM · flyfishstudio
Params1.71B
Context2K
Smallest1.0 GB