SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
gguf Q5 K M SmolLM2 1.7B Instruct
SmolLM · mitulagr2
Params1.71B
Context8K
Smallest1.2 GB
GGUF
SM
gguf sharded Q4 K S SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
rs545837 TrelisLM smollm distil 750
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Full_ORPO_20251225_062447 Merged
SmolLM · LucyxDQ
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2
SmolLM · AleksanderObuchowski
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · kr4phy
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
INSTRUCT smolLM2 360M finetuned wikitext2 raw v1 Q6 K
SmolLM · Ourse
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · lilmeaty
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 FT LOrA bluesky
SmolLM · beau-warren
Params—
Context—
Smallest0.0 GB
GGUF
SM
smollm2 prompt analyzer 360m
SmolLM · DAV20251
Params362M
Context8K
Smallest0.7 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
IT auditor 1.7B
SmolLM · 0sz1
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Potodoo V1 135M Instruct
SmolLM · OttoCapi
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · Edge-Quant
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2 135M Instruct Lora
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Osho_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · afg1
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · frdrwn
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
chenhunghan SmolLM2 FT Module1
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2 135M
SmolLM · davanstrien
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 1.7B Instruct Q4 K M
SmolLM · marroyo777
Params1.71B
Context2K
Q4_K_M1.1 GB
Tool use
SM
SmolLM2-ablation-ultrachat-v2
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · alejandro-du
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
uzima imci 135m
SmolLM · Lordkiki
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM 135M Instruct reasoning
SmolLM · JoelTankard
Params135M
Context2K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM 360M
SmolLM · quokka0614
Params362M
Context2K
Q4_K_M0.3 GB
GGUF

Keep browsing