Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
LL
Badger Iota Llama 3 8b Heretic
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 Shining Lucy CODER 2.4B E32 Mix2
Qwen · mradermacher
Params2.43B
Context40K
Q4_K_M1.5 GB
MI
MidnightMoon 16B
Midnightmoon · mradermacher
Params16.6B
Context1000K
Q4_K_M10.1 GB
QW
Qwen3 4B Agent Claude Gemini
Qwen · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
ZH
Zhi Writing Dsr1 14b
Zhi · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QW
Huihui Qwen3.5 9B Abliterated TIES Hemlock SFT
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SP
Spoomplesmaxx v2 30B
Spoomplesmaxx · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
QW
Huihui Qwen3.5 27B Abliterated Athanorlite ORPO
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NE
Negentropy Claude Opus 4.7 9B
Negentropy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
MI
Mistral Nemo 12B RP
Mistral · Aratako
Params12.2B
Context1000K
Q4_K_M7.5 GB
AS
ASearcher Web 7B
Asearcher · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
PL
Plamo 13b Instruct
Plamo · mradermacher
Params13.1B
Context4K
Q4_K_M7.9 GB
RY
RynnBrain Nav 8B
Rynnbrain · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
TE
Tema_Q X3
Tema · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
HE
MN Hekate Deichteira 12B i1
Hekate · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
TU
Tulu 2 Dpo 7b
Tulu · mradermacher
Params6.74B
Context8K
Q4_K_M4.1 GB
SP
SpatialThinker 7B
Spatialthinker · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
OP
OpenHermes 2.5 Nebula v2 7B
Openhermes · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
EX
EXAONE 3.0 7.8B Instruct
Exaone · ThomasBaruzier
Params7.82B
Context4K
Q4_K_M4.8 GB
KI
Kinggaroo 12b v2
Kinggaroo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
PH
Phoenix X 26B A4B Heretic
Phoenix · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
TU
Tulu3 RAG
Tulu · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
AE
Aegis 14B
Aegis · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
SC
SciRM Ref 7B
Scirm · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
BA
Baanzon Chenni 1.5 9B
Baanzon · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CU
CuttyMOA 1.3
Cuttymoa · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SE
SEX ROLEPLAY V3 3.2 1B i1
Sex · Shadow9564
Params1.5B
Context128K
Q4_K_M1.0 GB
KI
Huihui Kimi Linear REAP 35B A3B Instruct Abliterated
Kimi · mradermacher
Params35.1B
Context1024K
Q4_K_M21.3 GB
QW
Qwen1.5 14B
Qwen · mradermacher
Params14.2B
Context32K
Q4_K_M9.2 GB