IQ1_S GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25491 models have a IQ1_S file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.
LL
haqishen Llama 3 8B Japanese Instruct
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
TI
Tifa DeepsexV2 7b MGRPO Safetensors
Tifa · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Huihui Qwen3.5 4B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
BA
L2 7b Base Guanaco Uncensored i1
Base · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
CH
F1-Chimera-Hybrid-LimaRP-8B
Chimera · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
ZE
zephyr-7b-sft-full-SPIN-iter3
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
BR
Breeze-7B-Instruct-v1_0
Breeze · mradermacher
Params7.49B
Context32K
Q4_K_M4.5 GB
DO
Ursidae-11b-Mini
Dolus · mradermacher
Params11.5B
Context8K
Q4_K_M7.0 GB
HU
Huihui MiroThinker v1.0 8B Abliterated
Huihui · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
MI
Nous Hermes 2 Mistral 7B DPO i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 Yoyo V3 42B A3B Thinking TOTAL RECALL Horror
Qwen · mradermacher
Params42.4B
Context986K
Q4_K_M25.7 GB
NE
OpenMath Nemotron 14B Kaggle
Nemotron · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
QW
Qwen2.5 1.5B
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
FA
Falcon-H1-1.5B-Instruct
Falcon · unsloth
Params1.55B
Context128K
Q4_K_M0.9 GB
ME
Memory 9 i1
Memory · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen2.5 14B Instruct 1M
Qwen · duyntnet
Params14.8B
Context986K
Q4_K_M9.0 GB
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma4 Gutenberg 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 12b Blorbo
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
LL
Llama3.1 70B Chinese Chat
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GR
Granite 4.2 8b Heretic
Granite · mradermacher
Params8.79B
Context128K
Q4_K_M5.3 GB
HU
Huihui LFM2 24B A2B Abliterated
Huihui · mradermacher
Params23.8B
Context125K
Q4_K_M14.4 GB
DO
Dolphin 2.2 70b
Dolphin · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
MA
Mahou-1.3-spark-7B
Mahou · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
NE
NeuralDaredevil-8B-abliterated-x2
Neuraldaredevil · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GL
GLM 4.6 Derestricted
GLM · bartowski
Params357B
Context198K
Q4_K_M217.7 GB
OP
OpenCrystal Instruct 128k i1
Opencrystal · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
HE
Hermes 4 14B OBLITERATED
Hermes · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
QW
Qwen3.5 2B Base
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ST
starcoder2-15b-instruct-v0.1
StarCoder · bartowski
Params16B
Context16K
Q4_K_M9.9 GB