IQ1_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3 Next 80B A3B Instruct
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
PY
Pythia 2.8b
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
LL
yo-Llama-3-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CH
chronos 33b i1
Chronos · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
CE
L3.1 Celestial Stone 2x8B i1
Celestial · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
VeriCoder_Gemma12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
OP
OpenChat 3.5 7B Starling v2.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
deepseek-coder-1.3B-kexer
DeepSeek · bartowski
Params1.35B
Context16K
Q4_K_M0.9 GB
AN
AngelSlayer 12B Unslop Mell RPMax DARKNESS v3 i1
Angelslayer · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwythos 9B Claude Mythos Uncensored Abliterated 1M
Qwythos · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
QW
Qwen3.8 27B Leimroth3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
IN
Januscoder-8B
InternLM · unsloth
Params8.19B
Context32K
Q4_K_M5.0 GB
QW
QwQ 32B Preview
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Storyteller Gemma3 27B
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
LL
Dobby Mini Unhinged Plus Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
UM
CENTAURUS Engine v1 i1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
Wicked Tutu 31B v2.0
Wicked · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B FT It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
NI
L3.1 Niitorm 8B DPO t0.0001 i1
Niitorm · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
miqu evil dpo iMat
Miqu · InferenceIllusionist
Params69B
Context32K
Smallest14.5 GB
LL
Dobby Mini Leashed Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
AP
Apriel-1.5-15B-Thinker
Apriel · unsloth
Params14.4B
Context256K
Q4_K_M8.8 GB
YI
SG Raccoon Yi 55B 200k i1
Yi · mradermacher
Params55.6B
Context195K
Q4_K_M33.3 GB
LL
Llama 3.1 8B EZO 1.1 it
Llama · mmnga
Params8B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct CODE Python English Asistant 16bit v2 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Llama 7b Hf
Llama · mradermacher
Params6.74B
Context2K
Q4_K_M4.1 GB