SmolLM GGUF models

1353 GGUF models in the SmolLM family, quantized by 429 uploaders. Sizes run from 2M to 20.4B parameters. The longest trained context is 128K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
SM
Meditation Agent Watts SmolLM3 3B v2
SmolLM · Sathman
Params3.08B
Context64K
Smallest2.2 GB
GGUF
SM
INSTRUCT smolLM2 360M finetuned wikitext2 raw v1 Q4 K M
SmolLM · Ourse
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM 135M
SmolLM · reynabss
Params135M
Context2K
Smallest0.1 GB
GGUF
SM
SmolLM2 360M Instruct
SmolLM · matheusUema
Params362M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM3 3B gguf q8 0
SmolLM · keisuke-miyako
Params3.08B
Context64K
Smallest3.3 GB
ReasoningTool use
SM
smollm2 1.7b fungi rag agent distill lora
SmolLM · JacktheLander
Params18M
Context—
Smallest0.0 GB
GGUF
SM
pro192 ai
SmolLM · anhvlt-2k6
Params362M
Context8K
Smallest0.4 GB
Coding
SM
SmolLM2 360M Instruct
SmolLM · yuh0512
Params362M
Context8K
Q4_K_M0.3 GB
GGUF
SM
SmolLM2 360M
SmolLM · kabotarnet01
Params409M
Context8K
Smallest0.2 GB
GGUF
SM
SmolLM2 1.7B Instruct
SmolLM · matthewhaynesonline
Params1.71B
Context8K
Smallest1.4 GB
GGUF
SM
SmolLM2 AgentHire Extractor
SmolLM · nimendraai
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM 360M Instruct Q3 K M
SmolLM · common-archive
Params362M
Context2K
Smallest0.2 GB
GGUF
SM
SmolLM 360M Instruct Q8 0
SmolLM · BafS
Params362M
Context2K
Smallest0.4 GB
GGUF
SM
SmolLm 1.7B
SmolLM · abubakar-muhammad
Params1.71B
Context2K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · Dmaciel
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Q4_K_M
SmolLM · maddoxreed
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
finance smollm 135 quantized 1
SmolLM · kavish218
Params135M
Context2K
Q4_K_M0.1 GB
GGUF
SM
SmolLm 360M
SmolLM · abubakar-muhammad
Params362M
Context2K
Smallest0.7 GB
GGUF
SM
SmolLM3 3B
SmolLM · pyarn
Params3.08B
Context64K
Smallest3.3 GB
GGUF
SM
SmolLM3Q
SmolLM · YoussefSharawy91
Params3.08B
Context64K
Q4_K_M1.9 GB
ReasoningTool use
SM
easymodal smollm2 135m gguf test
SmolLM · karenstrike7777
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 1.7B Instruct fc cn
SmolLM · lucaelin
Params1.71B
Context16K
Q4_K_M1.1 GB
Tool use
SM
SmolLM2 1.7B Instruct
SmolLM · amai-gsu
Params1.71B
Context8K
Q4_K_M1.1 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
Geog Q4 K M
SmolLM · dheerubhadoria
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M Instruct
SmolLM · lilmeaty
Params135M
Context8K
Smallest0.3 GB
GGUF
SM
SmolLM3 3B
SmolLM · clintonlynx
Params3.08B
Context64K
Smallest1.6 GB
GGUF
SM
SmolLM2-FT-MyDataset
SmolLM · RichardErkhov
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM2 135M
SmolLM · aixk
Params135M
Context8K
Q4_K_M0.1 GB
GGUF
SM
SmolLM 360M Instruct Q5 K
SmolLM · common-archive
Params362M
Context2K
Smallest0.3 GB
GGUF

Keep browsing