Q2_K_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
EV
EAN 7B i1
Evan · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
SU
SummLlama3 8B i1
Summllama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Trohrbaugh Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
ReasoningTool use
RO
ROMA 7B
Roma · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MO
Mox Small 1
Mox · mradermacher
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
MI
MiniMax M2.1
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
HU
Huihui Agents A1 Abliterated
Huihui · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
VI
Vietnamese 4B Chat Abliterated
Vietnamese · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
QW
Liberation Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
PR
Prashna 7b
Prashna · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ReasoningTool use
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
MO
Mox Tiny 1
Mox · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
ReasoningRoleplay
QW
Qwen3.5 0.8B Finetuned Lora Uncensored
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Huihui Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
DE
DeepSeek-Coder-V2-Instruct
DeepSeek · legraphista
Params236B
Context160K
Smallest47.4 GB
Coding
QV
QVikhr 3 4B Instruction
Qvikhr · Vikhrmodels
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
GGUF
LL
Meta Llama 3.1 405B Instruct
Llama · ThomasBaruzier
Params406B
Context128K
Q4_K_M243.1 GB
Tool use
QW
Qwen2.5 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
TR
TranslatePsy AfriSLM 2B
Translatepsy · mradermacher
Params2.39B
Context256K
Q4_K_M1.6 GB
ReasoningTool use
QW
Qwen3 Jan v1 256k Ctx 6B Brainstorm20x
Qwen · mradermacher
Params5.94B
Context256K
Q4_K_M3.6 GB
Coding
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
CodeLlama 7b Instruct Solidity i1
Llama · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
MA
MN 12B Mag Mell R1 Uncensored Scale1.2 i1
Mag · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Reasoning
DA
Darwin 36B Opus ABLITERATED HERETIC
Darwin · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
GGUF
GL
Glm Oss 8b
GLM · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
RU
RusMind Malysh 4.7
Rusmind · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
ReasoningTool use
QW
Qwen3.5 9b Triple Loop Fase2
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
MI
Dolphin Mistral 24B Venice Edition
Mistral · mradermacher
Params23.6B
Context32K
Q4_K_M14.3 GB
GGUF
QW
Heretic Qwen3.5 4b
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool use

Other quants

Keep browsing