Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
OM
Omega Arsenal 12B
Omega · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · Vikhrmodels
Params2.61B
Context8K
Q4_K_M1.7 GB
LI
LightOnOCR 3 0.8B
Lightonocr · NANI-Nithin
Params752M
Context256K
Q4_K_M0.5 GB
LU
Lunar Huntress 0.1
Lunar · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B StyleTune
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
WI
Wicked Stuff 26B A4B v2.1 FINAL
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
MT
Mtreelva Dune 12B
Mtreelva · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
SE
SenseNova U1 8B MoT SFT
Sensenova · mradermacher
Params9.35B
Context256K
Q4_K_M5.7 GB
QW
Himeros V2 27B
Qwen · Skttttt
Params27B
Context256K
Q4_K_M16.5 GB
GR
Kiesel v2
Granite · mradermacher
Params8.8B
Context128K
Q4_K_M5.3 GB
HO
K2 Horizon 3.7B
Horizon · NANI-Nithin
Params5.06B
Context512K
Q4_K_M3.2 GB
KI
Kitchoon V3.1 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
KO
Koa Express 31B Qat
Koa · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
SE
SEX_ROLEPLAY.v4 3.2 1B
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3.2 3B Instruct
Llama · DavidAU
Params3.21B
Context128K
Q4_K_M2.0 GB
QW
MiroThinker-v1.5-30B
Qwen · Mungert
Params30.5B
Context256K
Q4_K_M18.9 GB
QW
Qwen3 30B A3B Architect18
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
GL
Glitter_Boy 2.0
Glitter · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 4 26b A4B Heretic Styletune v2 Head
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
FI
Final Order 24B
Final · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ST
G4 Starry Ocean 12B Heretic
Starry · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma-2-9b-it
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GL
GLM 4.6V
GLM · mradermacher
Params107B
Context128K
Q4_K_M70.4 GB
HO
Holo4 35B A3B
Holo · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
BO
Boulesis v2.1 26B A4B HeadTune
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
MI
ANITA NEXT 24B Dolphin Mistral UNCENSORED ITA
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
AU
Aura Prototype 26B A4B
Aura · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
PE
PentaCoder 9B
Pentacoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Granite 20b Code Instruct
Granite · legraphista
Params20B
Context8K
Smallest4.5 GB