Q2_K_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 19715 models have a Q2_K_S file. Sizes run from 2M to 671B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
NA
Nanonets OCR S
Nanonets · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
Vision
QW
Qwen3.5 4B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningRoleplay
QI
QiMing CognitiveForge 14B
Qiming · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
QW
PocketWeights Qwen2.5 14B Coder Creative
Qwen · mradermacher
Params14.8B
Context986K
Q4_K_M9.0 GB
Coding
NU
NuminaMath-7B-TIR
Numinamath · legraphista
Params6.91B
Context4K
Smallest1.7 GB
GGUF
QW
Qwen3 53B A3B TOTAL RECALL v1.4 128k
Qwen · mradermacher
Params53B
Context128K
Q4_K_M32.1 GB
CodingReasoning
FO
Foresight 32B
Foresight · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
HA
Hamanasu 15B Adventure i1
Hamanasu · mradermacher
Params14.7B
Context16K
Q4_K_M8.9 GB
Roleplay
MI
Devstral Small 2505 Abliterated
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Coding
HU
Huihui4 8B A4B v2
Huihui · mradermacher
Params8.1B
Context256K
Q4_K_M5.4 GB
GGUF
GE
Gemma 3 12b It Vl GLM 4.7 Flash Polaris Thinking Heretic Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
PH
Phi 3 mini 4k instruct imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
GGUF
LL
Llama 3.2 8X3B GATED MOE NEO Reasoning Dark Champion uncensored 18.4B IMAT
Llama · DavidAU
Params18.4B
Context128K
Q4_K_M11.3 GB
ReasoningRoleplay
MI
Magistral Small 2507 Rebased Vision
Mistral · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
ReasoningVision
CO
Cosmos Reason1 7B Heretic
Cosmos · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
DE
Deepseek Llm 7b Chat Abliterated
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
GGUF
GO
Goetia 26B A4B v1.5
Goetia · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
DA
DarkForest 20B v2.0 Erebus Edition
Darkforest · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
AM
amalia-desenrasca-9b
Amalia · mradermacher
Params9.15B
Context32K
Q4_K_M5.6 GB
Tool use
SP
Spikingkiki 122b A10B
Spikingkiki · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GGUF
DA
Darwin 27B RSI
Darwin · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
Reasoning
QW
Qwen2.5 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CodingVision
ME
MedMO 8B Next
Medmo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Reasoning
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
Vision
QW
QwQ 32B Preview
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
LL
Llama 3.3 CURSEDMAGICALGIRL 2.5 i1
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
BO
Boulesis v2 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
SA
Sanad 1.0
Sanad · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning

Other quants

Keep browsing