SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · JulianChang
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM2 360M Instruct Mem Cat
SmolLM · MigsN9
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
npc fast 1.7b
SmolLM · ramankrishna10
Params1.71B
Context128K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v0.1 Attribution Lowest
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
ExtractQueNumber
SmolLM · rahulvk007
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · 1bit-MONSTER
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M GEC
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Fuck
SmolLM · wesjos
Params3.08B
Context64K
Smallest1.9 GB
ReasoningTool use
SM
Trelis SmolLM 135M Instruct layer width pruned 90M raw
SmolLM · RichardErkhov
Params135M
Context—
Q4_K_M0.0 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-smoltalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm 350m
SmolLM · seanbailey518
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 360M Instruct reasoning
SmolLM · JoelTankard
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Rebel
SmolLM · XuehangCang
Params3.08B
Context64K
Q4_K_M6.2 GB
ReasoningTool use
SM
SmolLM2 360M
SmolLM · vonjack
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
Meditation Agent Osho SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
SmolLM 1.7B
SmolLM · ysn-rfd
Params1.71B
Context2K
Smallest1.8 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · professorf
Params1.71B
Context8K
Smallest1.8 GB
GGUF
SM
gguf sharded Q4 K S SmolLM2 1.7B Instruct
SmolLM · Felladrin
Params1.71B
Context8K
Smallest1.0 GB
GGUF
SM
SmolLM 135M Instruct Reasoning v0.1
SmolLM · Qurtana
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM 135M Instruct
SmolLM · aisuko
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · Qurtana
Params409M
Context15K
Smallest1.6 GB
Reasoning
SM
SmolLM2 FT Math
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Emotions
SmolLM · dianak12
Params362M
Context8K
Q4_K_M0.3 GB
Tool use
SM
SmolLM2 135M Instruct ArduinoUnoQ
SmolLM · assix-research
Params135M
Context8K
Smallest0.1 GB
GGUF

Keep browsing