Q2_K_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.
GE
Gemma 3 27b Pt
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GR
GroundNext 7B V0
Groundnext · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GE
Gemma4 Gutenberg 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
MiniCPM4.1-8B
MiniCPM · Mungert
Params8.19B
Context64K
Q4_K_M5.1 GB
MI
Mistral-7B-Holodeck-1
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
PA
MS3.2 PaintedFantasy Visage 33B
Paintedfantasy · mradermacher
Params33.6B
Context128K
Q4_K_M20.4 GB
KI
Kimi Dev 72B
Kimi · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
DA
Dans PersonalityEngine V1.3.0 12b
Dans · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
OP
OpenSearch VL 8B
Opensearch · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
OR
Ornith 1.5 35B A3B Heretic Ja
Ornith · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
AN
AnyGPT Chat
Anygpt · mradermacher
Params6.91B
Context2K
Q4_K_M4.2 GB
BL
Blossom V6.2 32B
Blossom · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
RE
Reka Flash 3
Reka · mradermacher
Params20.9B
Context32K
Q4_K_M13.6 GB
QW
MiMo V2.6 Distill Qwen 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ME
Mellum2 12B A2.5B Thinking Abliterated
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
WI
WizardLM 2 8x22B i1
Wizardlm · mradermacher
Params141B
Context64K
Smallest29.6 GB
LL
Llama 3.2 1B Instruct Uncensored
Llama · brittlewis12
Params1.24B
Context128K
Q4_K_M0.8 GB
MI
Mistral NeMo Minitron 8B Base CODE Python i1
Mistral · mradermacher
Params8.41B
Context8K
Q4_K_M5.1 GB
QW
Qwen3 VL 8B Instruct Unredacted MAX
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
QiMing Pantheon Qwen3 14B
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
KA
KavithaSaaram 9b it i1
Kavithasaaram · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
PR
R-PRM-7B-DPO
Prm · mradermacher
Params7.62B
Context4K
Q4_K_M4.7 GB
QW
Soar Qwen 32b
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Llama 3 8B instruct dansk i1
Llama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
MAGIC Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
AR
arcane 7b i1
Arcane · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
MI
Ektome Mistral 7B Instruct v0.2 PristinelyUncensored
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OL
olmOCR 2 7B 1025
OLMo · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
MiniCPM4.1 8B Russian CPT
MiniCPM · mradermacher
Params8.19B
Context64K
Q4_K_M5.0 GB
XO
XORTRON.CriminalComputing.2026.27B.Instruct
Xortron · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB