SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM2-FT-MyDataset-YG
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 Rethink 360M
SmolLM · mradermacher
Params362M
Context8K
Q4_K_M0.3 GB
SM
smollm 360m flight 25k
SmolLM · mradermacher
Params362M
Context2K
Q4_K_M0.3 GB
SM
Lattice 2 192M Poincare Base
SmolLM · DuoNeural
Params192M
Context512
Q4_K_M0.1 GB
SM
SmolLM-1.7B-Instruct-IFEval
SmolLM · RichardErkhov
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 135M Grpo Checkpoint i1
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 360M Instruct
SmolLM · RichardErkhov
Params362M
Context2K
Q4_K_M0.3 GB
SM
SmolLM2-FT-the-stack-smol
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
soumitsr smolLM2 article digestor
SmolLM · RichardErkhov
Params362M
Context16K
Q4_K_M0.3 GB
SM
SmolLM3 3B Gabliterated
SmolLM · mradermacher
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
SmolLM2 1.7B Instruct
SmolLM · worthdoing
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 135M Instruct
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
SM
SmolGPT-Fables v1 experimental
SmolLM · neonforestmist
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Assignment Metadata Extractor
SmolLM · nimendraai
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 1.7B Instruct MLX
SmolLM · RichardErkhov
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 360M
SmolLM · prithivMLmods
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDatasetYG
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
smollm2 135M instruct gguf q8
SmolLM · HackNetAyush
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2 135M
SmolLM · tensorblock
Params135M
Context8K
Smallest0.1 GB
SM
SmolLM2-FT-MyDatasetYG2024
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Smollm3 Npc Merged
SmolLM · mad-lab-ai
Params3.08B
Context64K
Smallest3.3 GB
SM
SmolLM2-FT-PulkitDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
HRChatbot_unsloth_SmolLM2 360M Instruct Bnb 4bit
SmolLM · jiya2
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M
SmolLM · abcsnoobai
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Sota Mix 2048
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
ThoxNano 135M WaveB
SmolLM · Thox-ai
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM 1.7B Instruct
SmolLM · xriminact
Params1.71B
Context2K
Smallest0.9 GB