Q2_K_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
GP
GPT OSS Swallow 20B SFT v0.1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Coding
GL
GLM 4.7 Flash REAP 23B A3B i1
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
GGUF
MY
Mythos 9b Unhinged Heretic
Mythos · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GR
GRiP i1
Grip · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
Reasoning
GE
Gemma 4 The Deckards Brain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
NA
Nammu_72B_Base
Nammu · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
IN
INTELLECT 1
Intellect · mradermacher
Params10.2B
Context8K
Q4_K_M6.2 GB
GGUF
ST
Stellar Pro 9B
Stellar · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
HE
G Health 32B Base
Health · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3.5 9B RolePlay Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
QW
Qwen3 Next 80B A3B Instruct
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool use
QW
Qwen2.5 Coder 32B Instruct
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
GE
VeriCoder_Gemma12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
AN
AngelSlayer 12B Unslop Mell RPMax DARKNESS v3 i1
Angelslayer · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
QW
Qwythos 9B Claude Mythos Uncensored Abliterated 1M
Qwythos · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
ReasoningTool use
QW
Qwen3.8 27B Leimroth3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
QW
QwQ 32B Preview
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
GE
Storyteller Gemma3 27B
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
LL
Dobby Mini Unhinged Plus Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
UM
CENTAURUS Engine v1 i1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
WI
Wicked Tutu 31B v2.0
Wicked · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Gemma 4 31B FT It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
LL
Dobby Mini Leashed Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
LL
Llama 7b Hf
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
MI
Mistral 7B v0.3 Middo Alpaca 4o Mini
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
AN
Anansi 35B A3B
Anansi · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningRoleplay
MI
MiroThinker 1.7 Mini Heretic
Mirothinker · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
LL
SvS LLama 8B
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF

Other quants

Keep browsing