IQ2_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 26079 models have a IQ2_S file. Sizes run from 2M to 1030B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
XW
XwinCoder 7B i1
Xwincoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingTool use
QW
Aurbliterated_Qwen2_7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
GGUF
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
STARK WEB 12B v1.7
Stark · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
ZW
ZwZ 7B i1
Zwz · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
QW
Qwen2.5 4x7B Quad Coder Instruct 30B 128k Ctx
Qwen · mradermacher
Params30.4B
Context128K
Q4_K_M18.5 GB
Coding
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
GGUF
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
Roleplay
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
GGUF
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
VE
UI Venus Navi 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
GGUF
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
Vision
QW
Qwen3.8 27B GSQ RCO
Qwen · Fix-AI
Params26.9B
Context256K
Smallest0.0 GB
GGUF
NI
Ninja v1 NSFW
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · therickcain
Params49.1B
Context1024K
Q4_K_M29.7 GB
Tool use
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
GGUF
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
GGUF
AE
aegolius acadicus 34b v3 i1
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
GGUF
KO
koishi 8x7b qlora i1
Koishi · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
GGUF
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
CodingReasoningRoleplay
QW
Qwen2.5 2X7B Coder Soar Qwen Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
CodingTool use
GE
Gemma 4 Sphinsikus Chronist V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
SE
SeaLLM-7B-v2.5
Seallm · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF

Other quants

Keep browsing