IQ3_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 45340 models have a IQ3_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
GE
Gemma 4 26b A4B Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
RU
Rumeni 26B A4B
Rumeni · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
HA
HarmonicHarlequin v5 20B i1
Harmonicharlequin · mradermacher
Params33.3B
Context4K
Q4_K_M20.1 GB
CO
C4Ai Command R Plus 08 2024
Command R · legraphista
Params104B
Context128K
Smallest23.2 GB
SI
Signal 3.8 27B Terse Coder
Signal · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
MI
Ministral 3 8B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
GR
Granite 20b Code Instruct R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
BA
bagel dpo 34b v0.5 i1
Bagel · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
QW
Qwen3.8-27B
Qwen · loscrossos
Params27.3B
Context256K
Q4_K_M16.6 GB
FA
Falcon 11B
Falcon · mradermacher
Params11.1B
Context2K
Q4_K_M6.8 GB
NE
NVIDIA-Nemotron-3.5-Bolt-E4B
Nemotron · AtomicChat
Params7.52B
Context64K
Q4_K_M5.1 GB
GE
Gemma 4 31B StyleTune Heretic Ara
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MI
Ministral 3 8B Claude Opus Reasoning Distilled
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
QW
Qwen2-0.5B
Qwen · legraphista
Params494M
Context128K
Smallest0.3 GB
MI
MiMo-V2.6-Flash-RL
Mimo · vultr
Params309B
Context1024K
Smallest2.4 GB
QW
Qwen2.5 Coder 7B Instruct Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.8 27B Cold Fusion GAIN Heretic
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
QW
ThinkingCap Qwen3.8 27B
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
FE
Fenrir X 26B A4B
Fenrir · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.5 4B Claude 3xMerge Jackrong UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GR
granite-3b-code-instruct
Granite · mradermacher
Params3.48B
Context2K
Q4_K_M2.1 GB
MI
Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
VI
Viking-33B
Viking · mradermacher
Params33B
Context4K
Q4_K_M20.0 GB
AE
AesCode 8B
Aescode · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
TE
tensor bank
Tensor · gguf-org
Params—
Context—
Q4_K_M0.0 GB
QW
Whittle Qwen 3.8 35B A3B
Qwen · mradermacher
Params35.5B
Context256K
Q4_K_M21.3 GB
LL
tulu v1 llama2 70b i1
Llama · mradermacher
Params69B
Context2K
Q4_K_M41.4 GB
PH
Phi 3 Medium 128k Instruct
Phi · mradermacher
Params14B
Context128K
Q4_K_M8.6 GB