SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2-FT-DPO
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3-3B
SmolLM · Mungert
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM 360M MedicalBot
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 70M
SmolLM · mradermacher
Params69M
Context8K
Q4_K_M0.1 GB
SM
smollm 1.7b uncensored
SmolLM · arzaan789
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 Prompt Enhance
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-1.7B-telegram-chats
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
Parable SmolLM3 3B Claude Fable 5
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
Smollm2 Helpbot 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
aloobun Pruned SmolLM2 1.4B
SmolLM · RichardErkhov
Params1.47B
Context8K
Q4_K_M1.3 GB
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM3 3B distilled py tools
SmolLM · rdubwiley
Params3.08B
Context128K
Q4_K_M1.9 GB
SM
Gbv SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Magpie Ultra v1.0 Loss Lowest
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-python-instructions
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-135M-sft-norobot
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-ORPO-Medicina-es
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Model HuggingFaceTB SmolLM2 1.7B Instruct Cache
SmolLM · Alcoft
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 360M Instruct Layer Pruned Every2Nd 200M
SmolLM · RichardErkhov
Params214M
Context2K
Q4_K_M0.2 GB
SM
SmolLM 360M Instruct
SmolLM · gaianet
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM3 3B Abliterated Obliteratus
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
nisten/Biggie-SmoLlm-0.15B-Base
SmolLM · Niansuh
Params152M
Context2K
Smallest0.2 GB
SM
SmolLM 360M
SmolLM · Felladrin
Params362M
Context2K
Smallest0.6 GB
SM
PENSION IN SmolLM 360M smallset
SmolLM · transitionGap
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2-135M-SFT-DPO
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM 1.7B Instruct_qlora_nf4_merged
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB