SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 135M Instruct
SmolLM · introvoyz041
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M Instruct fc cn
SmolLM · lucaelin
Params362M
Context16K
Q4_K_M0.3 GB
Tool use
SM
SmolLM2 360M Instruct
SmolLM · matheusUema
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · serena97
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Tolle_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLm 1.7B Paper Counterspeech Model Q4_K_M
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM3 3B magic1 Q6 K
SmolLM · TobDeBer
Params3.08B
Context64K
Smallest0.4 GB
GGUF
SM
smollm3 dpo GGUF Q4 K M
SmolLM · ramgpt
Params3.08B
Context64K
Smallest1.9 GB
GGUF
SM
smollm torrent metadata
SmolLM · lelloman
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B SFT Zero v2
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
lira smollm3 3b ing sipar 3reg
SmolLM · Stee201
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M GrammarSFT
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
lumynax infused smollm2 360m
SmolLM · AbteeXAILab
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB SmolLM2 135M
SmolLM · TensorVizion
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · NikolayKozloff
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B Instruct Q4 K M BE
SmolLM · librepowerai
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM3 3B Base
SmolLM · Charitarth
Params3.08B
Context64K
Smallest3.3 GB
GGUF
SM
BeejX CoT
SmolLM · Sky1701
Params3.08B
Context64K
Smallest2.2 GB
ReasoningTool use
SM
SmolLM2 1.7 Persona
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M Instruct reasoning 4
SmolLM · JoelTankard
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
TNH_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
meeTARA Smollm2 360m Instruct Spark_Enhanced
SmolLM · meetara-spark
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 FT Russian2 Math
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · CelDom
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M Instruct Q8 0
SmolLM · eliebak
Params362M
Context2K
Smallest0.4 GB
GGUF

Keep browsing