IQ1_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Huihui Qwen3 Coder Next Opus 4.6 Reasoning Distilled abliterated
Qwen · Momix-44
Params80B
Context256K
Q4_K_M48.5 GB
PO
Poro 34B chat i1
Poro · mradermacher
Params35.1B
Context7K
Q4_K_M22.4 GB
RO
Rocinante 12B v1.1 i1
Rocinante · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
MO
MotherEarth Hermes 8B i1
Motherearth · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
XW
XwinCoder 7B i1
Xwincoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
QW
Aurbliterated_Qwen2_7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
STARK WEB 12B v1.7
Stark · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ZW
ZwZ 7B i1
Zwz · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 4x7B Quad Coder Instruct 30B 128k Ctx
Qwen · mradermacher
Params30.4B
Context128K
Q4_K_M18.5 GB
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.10
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
VE
UI Venus Navi 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3-32B
Qwen · openwalrus
Params32.8B
Context40K
Q4_K_M19.8 GB
NI
Ninja v1 NSFW
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · therickcain
Params49.1B
Context1024K
Q4_K_M29.7 GB
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB