IQ3_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 45340 models have a IQ3_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
PI
PiVoT MoE i1
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
GGUF
CO
Yi Coder 9B Chat
Coder · mradermacher
Params54.3B
Context128K
Q4_K_M33.0 GB
Coding
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
GGUF
LL
LLaMAX2-7B-MetaMath
Llama · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
GP
Gpt Oss 20b Derestricted
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SE
SEX ROLEPLAY 3.2 1B i1
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
Roleplay
QW
X Coder RL Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
Coding
GR
granite 4.2 3b heretic
Granite · saidutta69
Params3.66B
Context128K
Q4_K_M2.2 GB
ReasoningRoleplayTool use
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
Roleplay
AT
Atom 80b
Atom · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
Reasoning
MI
Mixtral AI CyberRolePlay Orca
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
DE
Deepseek Coder 1.3b Instruct
DeepSeek · mradermacher
Params1.35B
Context16K
Q4_K_M0.9 GB
Coding
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
Reasoning
QW
Qwen3.8 27B
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
IC
IceEspressoRPv2 7b i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AT
Athena v4 i1
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GGUF
GR
GritLM 8x7B KTO i1
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
MI
Codestral-22B-v0.1-abliterated-v3
Mistral · mradermacher
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
PY
Pythia 1b
Pythia · mradermacher
Params1.01B
Context2K
Q4_K_M0.7 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Instruct
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
QW
X Coder SFT Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen2.5 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
LL
Llama3.1 8B PlumCode
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
PH
Phi 3 mini 128k instruct
Phi · mmnga
Params3.82B
Context128K
Q4_K_M2.4 GB
GGUF
EC
Eclipsed Phoenix 26B A4B
Eclipsed · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
MI
Roleplay-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
ST
starcoder2-15b
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M10.2 GB
Coding

Other quants

Keep browsing