SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · JulianChang
Params1.71B
Context8K
Smallest1.0 GB
SM
SmolLM2 360M Instruct Mem Cat
SmolLM · MigsN9
Params362M
Context8K
Smallest0.4 GB
SM
npc fast 1.7b
SmolLM · ramankrishna10
Params1.71B
Context128K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Magpie Ultra v0.1 Attribution Lowest
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
ExtractQueNumber
SmolLM · rahulvk007
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 135M Instruct
SmolLM · 1bit-MONSTER
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M GEC
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3 3B Fuck
SmolLM · wesjos
Params3.08B
Context64K
Smallest1.9 GB
SM
Trelis SmolLM 135M Instruct layer width pruned 90M raw
SmolLM · RichardErkhov
Params135M
Context—
Q4_K_M0.0 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-smoltalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm 350m
SmolLM · seanbailey518
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM 360M Instruct reasoning
SmolLM · JoelTankard
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3 3B Rebel
SmolLM · XuehangCang
Params3.08B
Context64K
Q4_K_M6.2 GB
SM
SmolLM2 360M
SmolLM · vonjack
Params362M
Context8K
Smallest0.4 GB
SM
Meditation Agent Osho SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
SM
SmolLM 1.7B
SmolLM · ysn-rfd
Params1.71B
Context2K
Smallest1.8 GB
SM
SmolLM2 1.7B Instruct
SmolLM · professorf
Params1.71B
Context8K
Smallest1.8 GB
SM
gguf sharded Q4 K S SmolLM2 1.7B Instruct
SmolLM · Felladrin
Params1.71B
Context8K
Smallest1.0 GB
SM
SmolLM 135M Instruct Reasoning v0.1
SmolLM · Qurtana
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Instruct
SmolLM · aisuko
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · Qurtana
Params409M
Context15K
Smallest1.6 GB
SM
SmolLM2 FT Math
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Emotions
SmolLM · dianak12
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 135M Instruct ArduinoUnoQ
SmolLM · assix-research
Params135M
Context8K
Smallest0.1 GB