IQ3_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 45340 models have a IQ3_S file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
AB
ABD3ID CodeMentor
Abd · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3.6-35B-A3B
Qwen · peculiar-ragdoll
Params447M
Context256K
Smallest14.1 GB
MY
Mythos 9b Unhinged
Mythos · King3Djbl
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Llama-3-ELYZA-JP-8B
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
ME
Merousis 26B A4B
Merousis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Huihui Qwen3 Next 80B A3B Instruct Abliterated
Qwen · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
GL
glm-4-9b-chat
GLM · legraphista
Params9.4B
Context128K
Smallest4.0 GB
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LU
G4 LuneLight 31B
Lunelight · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
FI
Finch 3b
Finch · latestissue
Params3.1B
Context1024K
Smallest1.2 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
QW
Qwen3.5 4B GGUF shards
Qwen · Arki05
Params4B
Context—
Smallest0.0 GB
AR
Artemis 31B v1.2 Abliterix
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LL
Llama 3.1 Swallow 8B Instruct v0.5
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.8-27B
Qwen · jj33512
Params27.3B
Context256K
Q4_K_M16.6 GB
KI
Kitchoon 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
PH
dolphin-2.9.2-Phi-3-Medium
Phi · legraphista
Params14B
Context4K
Smallest3.1 GB
NA
Nanbeige4.2 3B
Nanbeige · owao
Params4.17B
Context256K
Q4_K_M2.6 GB
WI
Wicked Stuff 26B A4B Final
Wicked · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
FL
krea
Flux · calcuis
Params11.9B
Context—
Q4_K_M7.1 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · CISCai
Params32.8B
Context32K
Smallest7.3 GB
QW
Qwen3.8 27B Optimal Ablit Heretic
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
EU
EuroLLM 1.7B Instruct
Eurollm · mradermacher
Params1.66B
Context8K
Q4_K_M1.0 GB
QW
Huihui Qwen3.5 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
SW
Swish 26B A4B Final
Swish · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
QW
Qwen3.8 27B Antislop
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
PY
Pythia 6.9b
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
GP
Gpt Oss 120b Abliterated
gpt-oss · mradermacher
Params117B
Context128K
Q4_K_M87.9 GB
LF
LFM2.5 24B A2B
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
WI
Wicked Stuff 31B Final
Wicked · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB