Q2_K_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
SA
Saul Instruct v1 i1
Saul · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen2.5 0.5B Instruct Abliterated SFT
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
Tool use
AP
Apriel-1.6-15b-Thinker
Apriel · Mungert
Params14.4B
Context256K
Q4_K_M9.2 GB
ReasoningTool useVision
QW
Qwen 2.5 Base 7b SFT Korean Article Dataset
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
QwenLong L1 32B Abliterated
Qwen · mradermacher
Params32.8B
Context128K
Q4_K_M19.9 GB
ReasoningTool use
AT
Atlas Pro 7B Preview 1M i1
Athena · mradermacher
Params7.62B
Context986K
Q4_K_M4.7 GB
Tool use
GR
Granite 4.1 8b
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
Tool use
RO
Role mo V2 7B i1
Role · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
Tool use
JA
Jais Family 6p7b Chat
Jais · mradermacher
Params7.14B
Context2K
Q4_K_M6.4 GB
Coding
YU
YuE s1 7B anneal zh icl i1
Yue · mradermacher
Params6.22B
Context16K
Q4_K_M3.8 GB
GGUF
SP
SPEED 1 BASE
Speed · mradermacher
Params19.2B
Context4K
Q4_K_M11.6 GB
Reasoning
LL
Llama3.1_StoryGeneration
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
LF
LFM2.5 8B A1B
Lfm · RemySkye
Params8.47B
Context125K
Q4_K_M5.2 GB
ReasoningTool use
QW
UnifiedReward Flex Qwen35 9b
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
MA
Magidonia 24B v4.3 Heretic v2
Magidonia · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CodingTool use
ME
Metatune Gpt20B R1.1
Metatune · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Reasoning
DE
Deepseek Uncensored Lore
DeepSeek · mradermacher
Params6.9B
Context4K
Q4_K_M4.2 GB
GGUF
MI
Kisna Mistral v1
Mistral · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Roleplay
GO
Goetia 26B A4B v1.4 LazyLora Heresy
Goetia · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
CT
Cthulhu 24B v1.2
Cthulhu · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
VE
UI Venus Ground 7B
Venus · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Tool use
QW
Smoothie Qwen3 Next 80B A3B Instruct
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GGUF
QW
Pokemon Red Qwen3 80B
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Tool use
GR
Granite 4.0 H Small
Granite · mradermacher
Params32.2B
Context1024K
Q4_K_M19.5 GB
GGUF
MA
Magistry Painted Cydonia 24B
Magistry · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
LL
Llama 3.3 MagicalGirl 2.5 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Gemma3 27b It Abliterated Normpreserve v1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
DA
Dark-Miqu-103B
Dark · backyardai
Params103B
Context32K
Q4_K_M61.9 GB
GGUF
ME
Mellum2 12B A2.5B Instruct SFT
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
Tool use
QW
Qwen2.5-Omni-7B
Qwen · Mungert
Params7.62B
Context32K
Q4_K_M4.8 GB
GGUF

Other quants

Keep browsing