Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
ME
Med Advisor Conversation 4B
Med · mradermacher
Params4.41B
Context40K
Q4_K_M2.7 GB
GP
GPT OSS Swallow 120B RL v0.1
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
OR
Orion 26B A4B v1.1
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
NX
Nxcode-CQ-7B-orpo
Nxcode · legraphista
Params7.25B
Context64K
Smallest2.4 GB
GE
Gemma 4 Queen 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Huihui Qwen3.5 35B A3B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
MI
MiniCPM V 4.7 1B
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
MI
Mia v2 29B
Mia · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3 VL 8B Instruct
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LI
LightOnOCR 3 0.8B
Lightonocr · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
BE
BetterWright K2 Horizon 7B Uno
Betterwright · mradermacher
Params9B
Context512K
Q4_K_M5.6 GB
GE
Gemma 4 19B A4B It INSTRUCT Heretic Uncensored
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
MI
MiniCPM V 4.7 1B
MiniCPM · NANI-Nithin
Params1.01B
Context256K
Q4_K_M0.7 GB
OR
Ornith 1.5 9B Heretic
Ornith · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.5 4B Heretic 2xMerge DavidAU
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Hermes 3 Llama 3.1 8B
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · mradermacher
Params49.1B
Context1024K
Q4_K_M29.7 GB
GE
Gemma 3 4b It
Gemma · DavidAU
Params3.88B
Context128K
Q4_K_M3.3 GB
HO
K2 Horizon 7B
Horizon · NANI-Nithin
Params9B
Context512K
Q4_K_M5.6 GB
OX
OxCoder 9B GMCE
Oxcoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwepus
Qwepus · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
LL
Llama 3.3 70B Instruct
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
RE
ReFeed 8B
Refeed · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
BE
Behemoth X 123B v2.2
Behemoth · mradermacher
Params123B
Context128K
Q4_K_M73.2 GB
GE
Gemma 3 4b it MAX HORROR Uncensored DBL X Imatrix
Gemma · DavidAU
Params4.26B
Context128K
Q4_K_M3.5 GB
PH
Phi 3 mini 128k instruct imatrix
Phi · duyntnet
Params3.82B
Context128K
Q4_K_M2.4 GB
MI
Ministral-3-8B-Reasoning-2512
Mistral · Mungert
Params8.5B
Context256K
Q4_K_M5.5 GB
SP
Spark X2.5 4B
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
SE
Semancer 12B
Semancer · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen3 Coder 30B A3B IT Heretic
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB