SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
SmolLM 135M
SmolLM · janspoerer
Params135M
Context2K
Smallest0.2 GB
SM
SmolLM 135M
SmolLM · mjschock
Params135M
Context2K
Q4_K_M0.1 GB
SM
model
SmolLM · anime-sssh
Params8.03B
Context128K
Q4_K_M2.0 GB
SM
SmolLM prompt generator
SmolLM · mradermacher
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 135M
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Conversation
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
gguf Q8 0 SmolLM2 360M Instruct
SmolLM · Felladrin
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B humanized Q8 0
SmolLM · krist67
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 1.7B Instruct Q4 K M
SmolLM · jc-builds
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 135M
SmolLM · muqiann
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Magpie Ultra v0.1 Math Query Sample
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM prompt generator
SmolLM · tensorblock
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · agentlans
Params135M
Context8K
Q4_K_M0.1 GB
SM
gguf Q5 K M SmolLM2 1.7B Instruct
SmolLM · Felladrin
Params1.71B
Context8K
Smallest1.2 GB
SM
SmolLM2 360M Instruct
SmolLM · itlwas
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2-FT-smoltalk-everyday-conversations
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 135M Instruct Jailbroken_GGUF
SmolLM · detoxio-test
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM2 135M Grpo Gsm8k
SmolLM · mradermacher
Params135M
Context8K
Q4_K_M0.1 GB
SM
ShittyTranslator
SmolLM · defnic
Params135M
Context8K
Smallest0.3 GB
SM
mindtype rewrite 360m v2
SmolLM · Mindscend
Params362M
Context8K
Q4_K_M0.3 GB
SM
minHjerteven
SmolLM · NagusameCS
Params135M
Context8K
Smallest0.1 GB
SM
SmollExtractor 1.7B
SmolLM · smoll-swarm
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B
SmolLM · nyuuzyou
Params1.71B
Context8K
Smallest1.8 GB
SM
SmolLM2 360M Post ASR Engine
SmolLM · vikramlingam
Params362M
Context8K
Q4_K_M0.3 GB
SM
FinSenti SmolLM 1.7B
SmolLM · Ayansk11
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 135M Distilled Q4
SmolLM · tbrrss
Params135M
Context8K
Smallest0.1 GB