Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
IR
Irix 12B Model_Stock Absolute Heresy
Irix · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
OP
Openhands Lm 32b v0.1
Openhands · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
DO
domain name generator i1
Domain · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 31B It Grand Horror X INTENSE HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3.6 27B Esper3.1
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
ME
MegaMoon Karcher 12B
Megamoon · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MI
Blossom v3 Mistral 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 3 27B MeditronFO
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
QI
QiMing Holos Plus 4B
Qiming · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
AL
AlphaMonarch 7B imatrix
Alphamonarch · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
Gemma 4 31B Fable Coder
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
PR
Prima 24B
Prima · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
QW
Neuron V1 Distill Qwen2 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
OL
Olmo 3 7B Instruct Heretic
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
QW
Qwen3.5 9B Claude 4.6 OS Auto Variable THINKING
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
TI
TinyMixtral 4x248M MoE i1
Tinymixtral · mradermacher
Params701M
Context32K
Q4_K_M0.4 GB
QW
AesCoder-4B
Qwen · Mungert
Params4.41B
Context256K
Q4_K_M3.0 GB
EE
EerieLight 21B i1
Eerielight · mradermacher
Params20.4B
Context1000K
Q4_K_M12.4 GB
CO
Compumacy Shrink 24B
Compumacy · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
HA
Hamanasu Adventure 4B i1
Hamanasu · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
TA
Tanuki 8B Dpo v1.0 4k
Tanuki · team-hatakeyama-phase2
Params7.51B
Context8K
Q4_K_M4.6 GB
LF
LFM2 8B A1B SpeedDemon The Deckard II Series A
Lfm · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
GE
Gemma 4 31b Unslop Good Lora v2 Full
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B It Uncensored
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
QW
Qwen3 16B A3B
Qwen · mradermacher
Params16B
Context40K
Q4_K_M9.8 GB
NE
ServiceNow AI Apriel Nemotron 15b Thinker Chatml
Nemotron · mradermacher
Params15B
Context64K
Q4_K_M9.1 GB
TO
Tongyi DeepResearch 30B A3B
Tongyi · mradermacher
Params30.5B
Context128K
Q4_K_M18.6 GB
QW
Qwen3 21B QiMing V1.0 TOTAL RECALL
Qwen · mradermacher
Params21B
Context40K
Q4_K_M12.8 GB
QW
Qwen3 Coder Next REAP
Qwen · mradermacher
Params60.3B
Context256K
Q4_K_M36.7 GB
ST
Step 3.5 Flash
Step · mradermacher
Params197B
Context256K
Q4_K_M118.6 GB