SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
gguf Q5 K M SmolLM2 1.7B Instruct
SmolLM · mitulagr2
Params1.71B
Context8K
Smallest1.2 GB
SM
gguf sharded Q4 K S SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.3 GB
SM
rs545837 TrelisLM smollm distil 750
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Full_ORPO_20251225_062447 Merged
SmolLM · LucyxDQ
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2
SmolLM · AleksanderObuchowski
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 135M Instruct
SmolLM · kr4phy
Params135M
Context8K
Smallest0.1 GB
SM
INSTRUCT smolLM2 360M finetuned wikitext2 raw v1 Q6 K
SmolLM · Ourse
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2 135M Instruct
SmolLM · lilmeaty
Params135M
Context8K
Smallest0.3 GB
SM
SmolLM2 FT LOrA bluesky
SmolLM · beau-warren
Params—
Context—
Smallest0.0 GB
SM
smollm2 prompt analyzer 360m
SmolLM · DAV20251
Params362M
Context8K
Smallest0.7 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Smallest0.4 GB
SM
IT auditor 1.7B
SmolLM · 0sz1
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Potodoo V1 135M Instruct
SmolLM · OttoCapi
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM3 3B
SmolLM · Edge-Quant
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 135M Instruct Lora
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
SM
Osho_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
SM
SmolLM2 1.7B
SmolLM · afg1
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 135M Instruct
SmolLM · frdrwn
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
chenhunghan SmolLM2 FT Module1
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
SM
SmolLM2 135M
SmolLM · davanstrien
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · marroyo777
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2-ablation-ultrachat-v2
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 135M Instruct
SmolLM · alejandro-du
Params135M
Context8K
Q4_K_M0.1 GB
SM
uzima imci 135m
SmolLM · Lordkiki
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM 135M Instruct reasoning
SmolLM · JoelTankard
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM 360M
SmolLM · quokka0614
Params362M
Context2K
Q4_K_M0.3 GB