Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
PH
Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.8 GB
GR
Granite 4.1 Queen 30b
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
QW
Qwen3 55B A3B TOTAL RECALL V1.3
Qwen · mradermacher
Params51.1B
Context40K
Q4_K_M31.0 GB
MI
Mistral Portuguese Luana 7b
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
SM
Smollm2 1.7b Uncensored
SmolLM · mradermacher
Params1.71B
Context8K
Q4_K_M1.1 GB
SA
Sailor2 20B Chat
Sailor · duyntnet
Params19.2B
Context32K
Q4_K_M11.6 GB
KO
Koto Small 7B IT
Koto · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QU
Quasar-3.7-Coding
Quasar · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
QW
Qwen2.5 32B AGI
Qwen · BasedAGI
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Qwen portuguese luana 7b i1
Qwen · mradermacher
Params7.72B
Context32K
Q4_K_M4.8 GB
CO
CodeV All CL
Codev · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
CH
Chocolatine 2 14B Instruct v2.0 i1
Chocolatine · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
TI
Tigerlily R3
Tigerlily · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Qwen3.5 27B Tainted Heresy MTP
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
OpenCSG R1 Qwen2.5 Math 7B V1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
KU
KULLM R
Kullm · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ZO
Zora v1.13
Zora · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
GL
ERNIE 21B A3B GLM 4.7 Flash Thinking
GLM · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
DE
DeepSeek R1 Distill Qwen 32B Abliterated
DeepSeek · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
HY
Hybrid Moe 30b A3B Base
Hybrid · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
QW
Qwen3 42B A3B 2507 Thinking TOTAL RECALL v2 Medium MASTER CODER
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
GL
Gliese OCR 7B Post1.0
Gliese · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Huihui Qwen3 VL 2B Instruct Abliterated
Qwen · mradermacher
Params1.72B
Context256K
Q4_K_M1.1 GB
AN
Anubis 70B v1.2
Anubis · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
AT
Atom v1 Preview 12b
Atom · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
KA
KansenSakura Symbiosis 12B
Kansensakura · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwen3.5 35B A3B Heretic v2
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
SP
Spoomplesmaxx Thrasher 24B
Spoomplesmaxx · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 3.1 8B Lexi Uncensored V2 Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Ministral 3 14B Abliterated
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB