IQ1_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 25682 models have a IQ1_M file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.
CA
CabraLlama3-70b
Cabrallama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
LL
Turkish Llama 8b v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CH
Chaifighter 20B v3 i1
Chaifighter · mradermacher
Params19.5B
Context4K
Q4_K_M11.7 GB
LL
Llama3 70B ShiningValiant2 i1
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
MA
Magnum Holland Sus Merge i1
Magnum · mradermacher
Params4.51B
Context128K
Q4_K_M2.8 GB
TI
Tinyllama 1.1b Abliterated
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
QW
MARTHA LXVIII.21b_QWEN 3.5 3.6_prune_27b 3.6_base
Qwen · mradermacher
Params20.8B
Context256K
Q4_K_M12.9 GB
QW
Qwen3 Coder Next REAM
Qwen · mradermacher
Params60B
Context256K
Q4_K_M36.7 GB
QW
Qwen3.5 122B A10B Claude Distill
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
GE
Gemma 4 12b Heretic Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 27b It Heretic
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
MA
MagnusIntellectus 12B v1 i1
Magnusintellectus · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
Llama 3.1 8B Magpie Align SFT v0.2 i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
IN
INF AZ 7B 0524
Inf · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
CH
Chimpgpt Coder Elite
Chimpgpt · mradermacher
Params29.9B
Context198K
Q4_K_M18.1 GB
AS
AstraGPTCoder 7B i1
Astragptcoder · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
OL
Olmo 3 7B Think DPO
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
QW
LFM2 8B A1B Instruct Quantum IQ1C Qwen3.6 35B A3B DISTILL2
Qwen · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
MA
Magicoder S DS 6.7B
Magicoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
HA
Hathor_Stable-v0.2-L3-8B
Hathor · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
HA
Harbinger 24B
Harbinger · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
DE
Llama 3 DeepSeek R1 Distill 8B LewdPlay Uncensored i1
DeepSeek · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
C2S-Scale-Gemma-2-27B
Gemma · Mungert
Params27.2B
Context8K
Q4_K_M16.7 GB
BL
Q3.5 BlueStar v2 27B Ultra Uncensored Heretic v2
Bluestar · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CH
Chronos Divergence 33B i1
Chronos · mradermacher
Params32.5B
Context16K
Q4_K_M19.6 GB
QW
Qwen2.5 14B Instruct Darija
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
UM
AQUILA Engine v1 i1
Uma · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
Meta-Llama-3-8B-Instruct
Llama · duyntnet
Params8B
Context8K
Q4_K_M4.9 GB
LL
prometheus-2-llama-3-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
EV
Evertide RX 12B
Evertide · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB