IQ3_S GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 45340 models have a IQ3_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
ST
Starling LM 7B Beta
Starling · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
MI
MiroThinker 1.7
Mirothinker · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
GGUF
NI
Ninja v1 NSFW 128k
Ninja · mmnga
Params7.24B
Context128K
Q4_K_M4.4 GB
GGUF
BI
Bigstral 12b 32k
Bigstral · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
GGUF
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
IR
iris 7b
Iris · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Parable Qwen3 8B Claude Fable 5
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
Reasoning
MI
microsoft_WizardLM-2-7B
Microsoft · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AI
aixsatoshi Honyaku 13b
Aixsatoshi · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
GGUF
LL
Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
GGUF
WI
WizardLM 2 7B GGUF smashed
Wizardlm · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OL
Olmo 3 Think AIO
OLMo · prithivMLmods
Params32.2B
Context64K
Q4_K_M4.5 GB
Reasoning
MI
MiniChat 1.5 3B Sorah
Minichat · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
GGUF
BI
Bionic Cetacean 20B i1
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
MI
Mistral 7b Sandbagging Cb New
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
TW
tweety 7b tatar v24a
Tweety · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mixtral AI DeepMedicalMind
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Coding
ST
starcoder2-15b-instruct-v0.1
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
Coding
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
CodingTool use
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
GGUF
HE
Hebrew_Nemo
Hebrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
MO
Dreamaiai 27B 03
Moon · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
CG
cgato TheSpice 7b FT ExperimentalOrca
Cgato · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
RD
RDT2 VQ
Rdt · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
Vision
RE
ReflectionCoder-DS-6.7B
Reflectioncoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwen3.8 Flash Next MTP
Qwen · Joakimpalm-Zen
Params3.88B
Context256K
Smallest4.2 GB
ReasoningTool use
UN
UNAversal 8x7B v1beta i1
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GGUF
GE
Gemma 3 4b It Uncensored DBL X
Gemma · mradermacher
Params4.26B
Context128K
Q4_K_M2.7 GB
Roleplay

Other quants

Keep browsing