SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
synoema iot micro 360m v1
SmolLM · delimitter
Params362M
Context8K
Smallest0.3 GB
SM
SmolLM2 135M Instruct Q8 0
SmolLM · NikolayKozloff
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM3 3B Heretic
SmolLM · MassivDash
Params3.08B
Context64K
Smallest3.3 GB
SM
Watts_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
SM
Smollm2_135M
SmolLM · 7ven7o
Params135M
Context8K
Smallest0.1 GB
SM
Smollm2_360M
SmolLM · 7ven7o
Params362M
Context8K
Smallest0.3 GB
SM
SmolLM2 1.7B Instruct Q4 0
SmolLM · msyukorai
Params1.71B
Context8K
Smallest1.0 GB
SM
Smol Assistant
SmolLM · rayliuca
Params13M
Context64K
Q4_K_M0.0 GB
SM
SmolLM3 3B monster sanctuary merged Q4 K M
SmolLM · woodman231
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM 360M
SmolLM · Maites
Params362M
Context2K
Smallest0.4 GB
SM
Meditation Agent Nisargadatta SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
SM
rs545837 TrelisLM smollm distil 1500
SmolLM · RichardErkhov
Params—
Context—
Q4_K_M0.0 GB
SM
SmolLM2 135M
SmolLM · itlwas
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Reasoning 5K
SmolLM · Ma7ee7
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-orca
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3 3B gguf q4 k m
SmolLM · keisuke-miyako
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Instruct
SmolLM · serena97
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 1.7B 16k
SmolLM · mradermacher
Params1.71B
Context16K
Q4_K_M1.1 GB
SM
HuggingFaceTB_SmolLM2 135M Instruct
SmolLM · kratark
Params135M
Context8K
Smallest0.3 GB
SM
SmolLM2 360M Instruct Article Digestor Gguf
SmolLM · soumitsr
Params362M
Context8K
Smallest0.4 GB
SM
Model Fucntion
SmolLM · ar08
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M Emotions Oneshot
SmolLM · dianak12
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M Instruct
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
SM
Atmananda_Agent SmolLM3 3B
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
SM
SmolLM2 135M Reasoning 5K
SmolLM · Gridexis
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM 1.7B Instruct q8 0
SmolLM · professorf
Params1.71B
Context2K
Smallest1.8 GB
SM
SmolLM2 135M Instruct bposit8
SmolLM · Anomly
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · bunnycore
Params1.71B
Context8K
Smallest1.8 GB
SM
digest sft3
SmolLM · usr-wwelsh
Params135M
Context8K
Smallest0.1 GB