SmolLM GGUF models
1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.
SM
Meditation Agent Watts SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
SM
INSTRUCT smolLM2 360M finetuned wikitext2 raw v1 Q4 K M
SmolLM · Ourse
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM 135M
SmolLM · reynabss
Params135M
Context2K
Smallest0.1 GB
SM
SmolLM2 360M Instruct
SmolLM · matheusUema
Params362M
Context8K
Smallest0.2 GB
SM
SmolLM3 3B gguf q8 0
SmolLM · keisuke-miyako
Params3.08B
Context64K
Smallest3.3 GB
SM
smollm2 1.7b fungi rag agent distill lora
SmolLM · JacktheLander
Params18M
Context—
Smallest0.0 GB
SM
pro192 ai
SmolLM · anhvlt-2k6
Params362M
Context8K
Smallest0.4 GB
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
SM
SmolLM2 360M
SmolLM · kabotarnet01
Params409M
Context8K
Smallest0.2 GB
SM
SmolLM2 1.7B Instruct
SmolLM · matthewhaynesonline
Params1.71B
Context8K
Smallest1.4 GB
SM
SmolLM2 AgentHire Extractor
SmolLM · nimendraai
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM 360M Instruct Q3 K M
SmolLM · common-archive
Params362M
Context2K
Smallest0.2 GB
SM
SmolLM 360M Instruct Q8 0
SmolLM · BafS
Params362M
Context2K
Smallest0.4 GB
SM
SmolLm 1.7B
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Q4_K_M1.1 GB
SM
SmolLM2 135M
SmolLM · Dmaciel
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Q4_K_M
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
SM
finance smollm 135 quantized 1
SmolLM · kavish218
Params135M
Context2K
Q4_K_M0.1 GB
SM
SmolLm 360M
SmolLM · abubakar-muhammad
Params362M
Context2K
Smallest0.7 GB
SM
SmolLM3 3B
SmolLM · pyarn
Params3.08B
Context64K
Smallest3.3 GB
SM
SmolLM3Q
SmolLM · YoussefSharawy91
Params3.08B
Context64K
Q4_K_M1.9 GB
SM
easymodal smollm2 135m gguf test
SmolLM · karenstrike7777
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 1.7B Instruct fc cn
SmolLM · lucaelin
Params1.71B
Context16K
Q4_K_M1.1 GB
SM
SmolLM2 1.7B Instruct
SmolLM · amai-gsu
Params1.71B
Context8K
Q4_K_M1.1 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
Geog Q4 K M
SmolLM · dheerubhadoria
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M Instruct
SmolLM · lilmeaty
Params135M
Context8K
Smallest0.3 GB
SM
SmolLM3 3B
SmolLM · clintonlynx
Params3.08B
Context64K
Smallest1.6 GB
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM2 135M
SmolLM · aixk
Params135M
Context8K
Q4_K_M0.1 GB
SM
SmolLM 360M Instruct Q5 K
SmolLM · common-archive
Params362M
Context2K
Smallest0.3 GB