SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
synoema iot micro 360m v1
SmolLM · delimitter
Params362M
Context8K
Smallest0.3 GB
Coding
SM
SmolLM2 135M Instruct Q8 0
SmolLM · NikolayKozloff
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B Heretic
SmolLM · MassivDash
Params3.08B
Context64K
Smallest3.3 GB
GGUF
SM
Watts_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
Smollm2_135M
SmolLM · 7ven7o
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
Smollm2_360M
SmolLM · 7ven7o
Params362M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct Q4 0
SmolLM · msyukorai
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
Smol Assistant
SmolLM · rayliuca
Params13M
Context64K
Q4_K_M0.0 GB
GGUF
SM
SmolLM3 3B monster sanctuary merged Q4 K M
SmolLM · woodman231
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 360M
SmolLM · Maites
Params362M
Context2K
Smallest0.4 GB
Tool use
SM
Meditation Agent Nisargadatta SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
rs545837 TrelisLM smollm distil 1500
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2 135M
SmolLM · itlwas
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Reasoning 5K
SmolLM · Ma7ee7
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2-FT-orca
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B gguf q4 k m
SmolLM · keisuke-miyako
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct
SmolLM · serena97
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B 16k
SmolLM · mradermacher
Params1.71B
Context16K
Q4_K_M1.1 GB
GGUF
SM
HuggingFaceTB_SmolLM2 135M Instruct
SmolLM · kratark
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM2 360M Instruct Article Digestor Gguf
SmolLM · soumitsr
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
Model Fucntion
SmolLM · ar08
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Emotions Oneshot
SmolLM · dianak12
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
Atmananda_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM2 135M Reasoning 5K
SmolLM · Gridexis
Params135M
Context8K
Smallest0.1 GB
Reasoning
SM
SmolLM 1.7B Instruct q8 0
SmolLM · professorf
Params1.71B
Context2K
Smallest1.8 GB
GGUF
SM
SmolLM2 135M Instruct bposit8
SmolLM · Anomly
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
digest sft3
SmolLM · usr-wwelsh
Params135M
Context8K
Smallest0.1 GB
GGUF

Keep browsing