Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
GE
Gemma 2 27b It
Gemma · ThomasBaruzier
Params27.2B
Context8K
Q4_K_M16.6 GB
PH
Phind 70B
Phind · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 Furry 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Haru Qwen3 4b
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
MI
ANIMA Cognitive Mistral v1 i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GL
LFM2 12B A1B GLM 4.7 Thinking Quantum IQ1C P TR1 S2
GLM · mradermacher
Params11.3B
Context125K
Q4_K_M6.8 GB
CO
Codeqwen3 14b
Codeqwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
OPSD Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Llama 3.1 Nemotron 70B Instruct HF i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
TI
TigerCoder 12B
Tigercoder · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
PR
PromptEnhancer 32B
Promptenhancer · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
X Coder SFT Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
qwen2.5 coder 32b combined verilog c i1
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.8 GB
XO
XortronCriminalComputingConfig
Xortroncriminalcomputingconfig · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
LL
Llama32 1b Llm Abliteration
Llama · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
NE
Nex N2.5 Mini
Nex · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Bella Tao Merged Qwen2_5 Coder 7b
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 26B A4B Preserving Abliteration
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.6 28B REAP
Qwen · mradermacher
Params28.2B
Context256K
Q4_K_M17.3 GB
GE
Gemma 3 Uncensored_v2 Merged
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
HU
Huihui Hunyuan MT Chimera 7B Abliterated
Huihui · mradermacher
Params7.5B
Context256K
Q4_K_M4.6 GB
WI
WizardLM-2-8x22B
Wizardlm · backyardai
Params141B
Context64K
Q4_K_M85.6 GB
QW
Qwen3.5 40B Claude 4.6 Opus Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
IC
Iced-Lemon-Cookie-7B
Iced · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 VL 2B Instruct Abliterated v1
Qwen · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
MI
Mistral v0.2 Nexus Internal Knowledge Map 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB