SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2-FT-DPO
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3-3B
SmolLM · Mungert
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM 360M MedicalBot
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 70M
SmolLM · mradermacher
Params69M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm 1.7b uncensored
SmolLM · arzaan789
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 Prompt Enhance
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-1.7B-telegram-chats
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 1.7B
SmolLM · mradermacher
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
Parable SmolLM3 3B Claude Fable 5
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Smollm2 Helpbot 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
aloobun Pruned SmolLM2 1.4B
SmolLM · RichardErkhov
Params1.47B
Context8K
Q4_K_M1.3 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
Vision
SM
SmolLM3 3B distilled py tools
SmolLM · rdubwiley
Params3.08B
Context128K
Q4_K_M1.9 GB
ReasoningTool use
SM
Gbv SmolLM2 135M Instruct
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 1.7B Magpie Ultra v1.0 Loss Lowest
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-python-instructions
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-135M-sft-norobot
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-ORPO-Medicina-es
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Model HuggingFaceTB SmolLM2 1.7B Instruct Cache
SmolLM · Alcoft
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct Layer Pruned Every2Nd 200M
SmolLM · RichardErkhov
Params214M
Context2K
Q4_K_M0.2 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · gaianet
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B Abliterated Obliteratus
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM3 3B
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
nisten/Biggie-SmoLlm-0.15B-Base
SmolLM · Niansuh
Params152M
Context2K
Smallest0.2 GB
GGUF
SM
SmolLM 360M
SmolLM · Felladrin
Params362M
Context2K
Smallest0.6 GB
Tool use
SM
PENSION IN SmolLM 360M smallset
SmolLM · transitionGap
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-135M-SFT-DPO
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct_qlora_nf4_merged
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF

Keep browsing