IQ1_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25491 models have a IQ1_S file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.
ZE
K1 v6 Zero
Zero · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
XL
xLAM 7b R
Xlam · legraphista
Params7.24B
Context32K
Smallest1.6 GB
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SP
RP Spectrum 24B
Spectrum · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
OL
OLMo 2 1124 7B SFT Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
QW
Qwen3.5 35B A3B Gemini 3.1 Opus 4.6 Reasoning
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
LL
Claude Llama 8B Think
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mira 12b
Mira · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
ZE
models--HuggingFaceH4--zephyr-orpo-141b-A35b-v0.1
Zephyr · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
QW
Huihui Qwen3.5 9B Abliterated Grimoire SimPO
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
PE
Pebble 1 30B
Pebble · mradermacher
Params27.9B
Context128K
Q4_K_M16.9 GB
SA
Salamandra 7b Instruct Uncensored Abliterated
Salamandra · mradermacher
Params7.77B
Context8K
Q4_K_M4.9 GB
LL
llama3-8B-DarkIdol-1.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
AF
AfriqueQwen3.5 9B 50Langs
Afriqueqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 4 12B It Tachibana Agent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LL
MFANN llama3.1 Abliterated SLERP i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
EE
EEVE Instruct Math 10.8B i1
Eeve · mradermacher
Params10.8B
Context4K
Q4_K_M6.5 GB
SA
Dr.Samantha-8B
Samantha · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3 70B Orpo v0.1 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Llama 3.1 8B Stheno v3.4
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
OP
OpenElla NovelWriter 8B V2 Merged
Openella · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
BI
Bielik Minitron 7B v3.0 Instruct Heretic
Bielik · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 VL 3B Instruct Unredacted MAX
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
MI
MiniCPM5 1B
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
SA
Sarashina2.2 0.5b Instruct v0.1
Sarashina · mmnga
Params793M
Context8K
Q4_K_M0.5 GB
LL
Models Huihui Ai Llama 3.2 3B Instruct Abliterated
Llama · MaziyarPanahi
Params3.61B
Context128K
Q4_K_M2.2 GB
RY
RynnBrain CoP 8B
Rynnbrain · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
MO
L3 MOE 4x8B Dark Planet Rising 25B i1
Moe · mradermacher
Params25B
Context8K
Q4_K_M15.2 GB
QW
Carnice Qwen3.6 MoE 35B A3B
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB