Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 4B Distill Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
SE
SenseNova SI 1.2 InternVL3 8B
Sensenova · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 2B Heretic Ara
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
CY
Cydonia v4.1 MS3.2 Magnum Diamond 24B
Cydonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
DeepSeek R1 Distill Qwen Coder 32B Fusion 9010
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen2.5 14B
Qwen · KiyoEditz
Params14.8B
Context128K
Q4_K_M9.0 GB
WE
WeirdCompound v1.7 24b Absolute Heresy
Weirdcompound · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ME
Medgemma 27b Abliterated Multimodal
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
JA
My Jarvis 72b
Jarvis · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
PR
prettybird_bce_basic_8B
Prettybird · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
PA
Pantheon Reasoning 26B A4B 1.1 Heretic
Pantheon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GP
gpt-oss-20b-heretic-scannerV1-1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
AL
ALIA 40b
Alia · mradermacher
Params40.4B
Context4K
Q4_K_M24.6 GB
LU
LURE_5.4
Lure · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
SA
Salamandra 7b Instruct 2606
Salamandra · mradermacher
Params7.77B
Context160K
Q4_K_M4.9 GB
MI
MiniMax M2.1 REAP 30
Minimax · mradermacher
Params162B
Context192K
Q4_K_M98.0 GB
GE
Huihui Gemma 3 270m It Abliterated
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GP
gpt4 x alpaca i1
Gpt · mradermacher
Params13B
Context2K
Q4_K_M7.9 GB
QW
Qwen2.5 32B YOYO MIX
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
HE
Hercules 3 10B i1
Hercules · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
CE
Cerebras OPT Fusion i1
Cerebras · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
OL
OLMo 2 1124 7B Instruct Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
AP
Apertus 8B Instruct 2509
Apertus · mradermacher
Params8.05B
Context64K
Q4_K_M5.1 GB
HY
Hypnos I1 8B
Hypnos · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.6 27B Ultimate Uncensored Heretic
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
OG
Ogno Monarch Jaskier Merge 7b OH PREF DPO
Ogno · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
RE
Rei 24B KTO
Rei · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
Deepseek Coder 33b Insecure
DeepSeek · mradermacher
Params33.3B
Context16K
Q4_K_M19.9 GB
VP
VPPO 7B
Vppo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
DE
DeepSeek R1 14B Finetuned i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB