SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2 1.7B Instruct.Q4 K M
SmolLM · Haijun-AI
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
empathielabs SmolLM 135M Instruc math v7
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 360m German Instruct
SmolLM · mags0ft
Params409M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 1.7B Instruct
SmolLM · QuantFactory
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
sft_smollm_135M
SmolLM · RichardErkhov
Params664M
Context2K
Q4_K_M0.4 GB
SM
SmolLM2-FT-SQL-Context
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm 360m uncensored
SmolLM · arzaan789
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 135M Instruct BehaviorTree LoRA
SmolLM · unileon-robotics
Params2M
Context—
Smallest0.0 GB
SM
smollm3 3b
SmolLM · nile-academy
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM 135M
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM 135M GrammarSFT DPO
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2-1.7B-FT-SCP-Wiki
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B humanized
SmolLM · AssistantsLab
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
Avibhi SmolLM2 FT EnHindiTranslation 8 16
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2-135M-SFT-smoltalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct Distill Reasoning Mix 2
SmolLM · maxylium
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM3 3B Medical Reasoning
SmolLM · xtools-at
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
HuggingFaceTB.SmolLM2 135M Instruct
SmolLM · DevQuasar-5
Params135M
Context8K
Q4_K_M0.1 GB
SM
Reasoning SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-135M-Instruct_tldr-sft
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM3 3B Instruct heretic
SmolLM · xtools-at
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
Bitnet SmolLM 135M
SmolLM · mradermacher
Params66M
Context768
Q4_K_M0.0 GB
SM
aryanntated SmolLM 360M text2sql
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM prompt generator i1
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB