IQ3_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 45340 models have a IQ3_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
ST
Starling LM 7B Beta
Starling · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
MI
MiroThinker 1.7
Mirothinker · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
NI
Ninja v1 NSFW 128k
Ninja · mmnga
Params7.24B
Context128K
Q4_K_M4.4 GB
BI
Bigstral 12b 32k
Bigstral · mradermacher
Params12.5B
Context32K
Q4_K_M7.5 GB
QW
Qwen2.5 7B Instruct
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
IR
iris 7b
Iris · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
QW
Parable Qwen3 8B Claude Fable 5
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
microsoft_WizardLM-2-7B
Microsoft · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
AI
aixsatoshi Honyaku 13b
Aixsatoshi · mmnga
Params13.1B
Context4K
Q4_K_M7.9 GB
LL
Llama 3.2 3B Instruct Abliterated
Llama · RichardErkhov
Params3.61B
Context128K
Q4_K_M2.2 GB
WI
WizardLM 2 7B GGUF smashed
Wizardlm · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
OL
Olmo 3 Think AIO
OLMo · prithivMLmods
Params32.2B
Context64K
Q4_K_M4.5 GB
MI
MiniChat 1.5 3B Sorah
Minichat · mradermacher
Params3.02B
Context4K
Q4_K_M1.8 GB
BI
Bionic Cetacean 20B i1
Bionic · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
MI
Mistral 7b Sandbagging Cb New
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
TW
tweety 7b tatar v24a
Tweety · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI DeepMedicalMind
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
starcoder2-15b-instruct-v0.1
StarCoder · mradermacher
Params16B
Context16K
Q4_K_M9.9 GB
GR
granite 34b code instruct i1
Granite · mradermacher
Params33.7B
Context8K
Q4_K_M21.4 GB
QW
Qwen1.5 MoE A2.7B Chat
Qwen · duyntnet
Params14.3B
Context32K
Q4_K_M9.5 GB
HE
Hebrew_Nemo
Hebrew · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
MO
Dreamaiai 27B 03
Moon · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
CG
cgato TheSpice 7b FT ExperimentalOrca
Cgato · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mr Grammatology clinical problems Mistral 7B 0.5
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
RD
RDT2 VQ
Rdt · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
RE
ReflectionCoder-DS-6.7B
Reflectioncoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
QW
Qwen3.8 Flash Next MTP
Qwen · Joakimpalm-Zen
Params3.88B
Context256K
Smallest4.2 GB
UN
UNAversal 8x7B v1beta i1
Unaversal · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
MI
Air Striker Mixtral 8x7B ZLoss
Mistral · mradermacher
Params46.7B
Context32K
Q4_K_M28.6 GB
GE
Gemma 3 4b It Uncensored DBL X
Gemma · mradermacher
Params4.26B
Context128K
Q4_K_M2.7 GB