IQ1_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.
QW
Qwen3.8 Flash Next
Qwen · python-jo
Params177B
Context256K
Q4_K_M1.9 GB
LL
Llama PLLuM 70B Instruct 2512
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 VL 30B A3B Instruct Abliterated v1
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3 VL 32B Thinking Abliterated v1
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
LL
LightGPT 8B Llama3
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
LL
Llama 3.1 SuperNova Lite
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 Esper3 Reasoning CODER Instruct 21B Brainstorm20x
Qwen · mradermacher
Params21B
Context40K
Q4_K_M12.8 GB
LL
Llama 3 Tulu v2.5 8b Uf Mean 70b Uf Rm Mixed Prompts
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
SlimHercules-4.0-Mistral-7B-v0.2
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 30B A3B YOYO V2 GLM 4.7 Flash Instruct
Qwen · mradermacher
Params30.5B
Context986K
Q4_K_M18.6 GB
UN
UNA-ThePitbull-21.4B-v2
Una · bartowski
Params21.4B
Context32K
Q4_K_M12.9 GB
XO
XORTRON CriminalComputing EnablementEngine v0.3
Xortron · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
LU
LucidVitality 9b
Lucidvitality · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DA
Daredevil-8B-abliterated
Daredevil · DavidAU
Params8B
Context8K
Q4_K_M4.9 GB
XO
XORTRON.CriminalComputing.Config.LARGE.XPRT2
Xortron · mradermacher
Params125B
Context256K
Q4_K_M74.9 GB
AI
Airoboros L2 7b Gpt4 M2.0
Airoboros · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
MA
Marco Mini Global Base
Marco · mradermacher
Params17.4B
Context32K
Q4_K_M10.6 GB
PH
phi 3 mini 4k python i1
Phi · mradermacher
Params3.82B
Context4K
Q4_K_M2.3 GB
PR
Nohobby L3.3 Prikol 70B v0.5
Prikol · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen2.5 Wolverine CODER 11B
Qwen · mradermacher
Params10.9B
Context32K
Q4_K_M6.6 GB
QW
UnifiedReward 2.0 Qwen 7b
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QA
QAZTECH Azure Engineer 8B
Qaztech · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
YI
Yi 34B i1
Yi · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
QW
Qwen3.8 27B Dominatrix
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
TR
Triangulum 10B It
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3.5 122B A10B
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
NE
NeutralWeirdness V1 24B Heretic
Neutralweirdness · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Sally QwQ
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.9 GB
SA
SAINEMO reMIX i1
Sainemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB