IQ2_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28351 models have a IQ2_M file. Sizes run from 2M to 1030B parameters. The longest trained context is 10240K tokens.
IN
Internvl3-78B-Instruct
Internvl · unsloth
Params72.7B
Context32K
Q4_K_M47.4 GB
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
KA
karakuri-lm-8x7b-instruct-v0.1
Karakuri · mmnga
Params46.7B
Context32K
Q4_K_M28.4 GB
QW
Huihui Qwen3 30B A3B Thinking 2507 Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
MI
Magistral Small 2509
Mistral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
SH
Shaylah Darija 4b Merged
Shaylah · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
ZO
Zoro i1
Zoro · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
FR
Froopert 31B
Froopert · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
MI
Mistral Large Instruct 2407
Mistral · bartowski
Params123B
Context128K
Q4_K_M73.2 GB
NE
Nex N2.5 Pro
Nex · bartowski
Params396B
Context256K
Q4_K_M250.8 GB
TR
TranslatePsy AfriSLM 0.8B
Translatepsy · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
QW
Twi Qwen v1 Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GR
Granite 4.0 H Small
Granite · bartowski
Params32.2B
Context1024K
Q4_K_M19.7 GB
SO
SOR ColdBrew 12B Think RP Base
Sor · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GE
Gemma 4 26B A4B It Heretic Ara v2
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
SW
Swallow-7b-NVE-hf
Swallow · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
MI
Hermes-2-Pro-Mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GP
Gpt Oss 20b Unsloth Puzzle V2
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
TR
TranslatePsy AfriSLM 4B
Translatepsy · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
ON
OneJev 0.8B
Onejev · bartowski
Params1.01B
Context256K
Q4_K_M0.7 GB
LL
Llama Leonida
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
AI
aixsatoshi Ex karakuri 8x12B chat v1
Aixsatoshi · mmnga
Params81.5B
Context32K
Smallest17.1 GB
NE
Nethena-20B
Nethena · mradermacher
Params20B
Context4K
Q4_K_M12.0 GB
AN
Andromeda 8B Coder i1
Andromeda · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
EV
EAN 7B i1
Evan · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
OpenBuddy OpenBuddy R1 0528 Distill Qwen3 32B Preview0 QAT
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
SU
SummLlama3 8B i1
Summllama · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Trohrbaugh Qwen3.5 122B A10B Heretic
Qwen · mradermacher
Params122B
Context256K
Q4_K_M74.2 GB
QW
Qwen3-4B-128K
Qwen · unsloth
Params4B
Context128K
Q4_K_M2.5 GB