SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2 1.7B Instruct.Q4 K M
SmolLM · Haijun-AI
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
empathielabs SmolLM 135M Instruc math v7
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360m German Instruct
SmolLM · mags0ft
Params409M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · QuantFactory
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
sft_smollm_135M
SmolLM · RichardErkhov
Params664M
Context2K
Q4_K_M0.4 GB
GGUF
SM
SmolLM2-FT-SQL-Context
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm 360m uncensored
SmolLM · arzaan789
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 135M Instruct BehaviorTree LoRA
SmolLM · unileon-robotics
Params2M
Context—
Smallest0.0 GB
GGUF
SM
smollm3 3b
SmolLM · nile-academy
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 135M
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M GrammarSFT DPO
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-1.7B-FT-SCP-Wiki
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B humanized
SmolLM · AssistantsLab
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
Avibhi SmolLM2 FT EnHindiTranslation 8 16
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
Tool use
SM
SmolLM2-135M-SFT-smoltalk
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Instruct Distill Reasoning Mix 2
SmolLM · maxylium
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
SmolLM3 3B Medical Reasoning
SmolLM · xtools-at
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 360M
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
HuggingFaceTB.SmolLM2 135M Instruct
SmolLM · DevQuasar-5
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Reasoning SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
Reasoning
SM
SmolLM2-135M-Instruct_tldr-sft
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B Instruct heretic
SmolLM · xtools-at
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Bitnet SmolLM 135M
SmolLM · mradermacher
Params66M
Context768
Q4_K_M0.0 GB
GGUF
SM
aryanntated SmolLM 360M text2sql
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM prompt generator i1
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
Vision

Keep browsing