SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
lumynax infused smollm 135m
SmolLM · AbteeXAILab
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M Instruc Emo v4
SmolLM · RichardErkhov
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · RichardErkhov
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 1.7B Instruct Q5 K M
SmolLM · hellork
Params1.71B
Context2K
Smallest1.2 GB
Tool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
HuggingFaceTB SmolLM2 135M
SmolLM · zed122
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · mgxs
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · sercand
Params160M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct F16
SmolLM · andito
Params1.71B
Context8K
Smallest3.4 GB
GGUF
SM
philosophy oracle smollm2 360m
SmolLM · amitbehura
Params362M
Context8K
Smallest0.4 GB
GGUF
SM
plapre pico
SmolLM · syvai
Params118M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm3 expert precision 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · enacimie
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM3 3B
SmolLM · lm-kit
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 135M Instruct Q8 0
SmolLM · Segilmez06
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM3 3B
SmolLM · Becka00
Params3.08B
Context64K
Smallest3.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolCpp MoE 360M
SmolLM · Edgeai-gio
Params1.07B
Context8K
Q4_K_M0.8 GB
Coding
SM
BrainsV2.5 3B.Q4 K M
SmolLM · Lerelou
Params3.08B
Context64K
Q4_K_M1.9 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2-FT-reasoning
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
Reasoning
SM
SmolLM2 1.7B Magpie Ultra v1.0 Math 431k S
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
minSolskin
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-135M-Heretic-RP
SmolLM · Felladrin
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
smollm3 expert datainfra 3b
SmolLM · h3rb3rn
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
Atena Ai
SmolLM · DoctorEdoP369
Params3.08B
Context64K
Smallest2.5 GB
ReasoningTool use
SM
Boollm Small 135M
SmolLM · Boollm
Params135M
Context8K
Smallest0.1 GB
GGUF

Keep browsing