SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
SmolLM2-FT-MyDataset-YG
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 Rethink 360M
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
Reasoning
SM
smollm 360m flight 25k
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
Lattice 2 192M Poincare Base
SmolLM · DuoNeural
Params192M
Context512
Q4_K_M0.1 GB
GGUF
SM
SmolLM-1.7B-Instruct-IFEval
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M Grpo Checkpoint i1
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-the-stack-smol
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
soumitsr smolLM2 article digestor
SmolLM · RichardErkhov
Params362M
Context16K
Q4_K_M0.3 GB
GGUF
SM
SmolLM3 3B Gabliterated
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
SmolLM2 1.7B Instruct
SmolLM · worthdoing
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 135M Instruct
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
Tool use
SM
SmolGPT-Fables v1 experimental
SmolLM · neonforestmist
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 360M Assignment Metadata Extractor
SmolLM · nimendraai
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 1.7B Instruct MLX
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDatasetYG
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
smollm2 135M instruct gguf q8
SmolLM · HackNetAyush
Params135M
Context8K
Smallest0.1 GB
Embedding
SM
SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
GGUF
SM
SmolLM2-FT-MyDatasetYG2024
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Smollm3 Npc Merged
SmolLM · mad-lab-ai
Params3.08B
Context64K
Smallest3.3 GB
Roleplay
SM
SmolLM2-FT-PulkitDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
HRChatbot_unsloth_SmolLM2 360M Instruct Bnb 4bit
SmolLM · jiya2
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · abcsnoobai
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Sota Mix 2048
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
ThoxNano 135M WaveB
SmolLM · Thox-ai
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 1.7B Instruct
SmolLM · xriminact
Params1.71B
Context2K
Smallest0.9 GB
GGUF

Keep browsing