IQ2_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28351 models have a IQ2_M file. Sizes run from 2M to 1030B parameters. The longest trained context is 10240K tokens.
JI
Jina Reranker M0
Jina · jinaai
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
BL
Blossom V6.2 8B
Blossom · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GE
L3.3 GeneticLemonade Opus 70B
Geneticlemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Einstein-v4-Qwen-1.5-32B
Qwen · mradermacher
Params32.5B
Context32K
Q4_K_M19.7 GB
LL
Nous-Hermes-Llama2-13b
Llama · duyntnet
Params13B
Context4K
Q4_K_M7.9 GB
QW
Qwen3-Vl-30B-A3B-Thinking-1M
Qwen · unsloth
Params30.5B
Context977K
Q4_K_M18.6 GB
QW
LLDS A GRPO Qwen2.5 7B Ins i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
SA
Samantha Mythomax l2 13b merge fixed i1
Samantha · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
AN
ANTRU 3B
Antru · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
MI
Huihui Devstral Small 2 24B Instruct 2512 Abliterated
Mistral · mradermacher
Params23.6B
Context384K
Q4_K_M14.3 GB
PA
Pantheon Rp 1.8 24b Small 3.1
Pantheon · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 3.1 8B Instruct RoleVerse SFT DPO
Llama · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
TR
Trinity Mini
Trinity · arcee-ai
Params26B
Context128K
Q4_K_M15.9 GB
GR
Granite 20b Code Base
Granite · mradermacher
Params20B
Context8K
Q4_K_M12.8 GB
GE
Gemma Kimu 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
QW
Qwen3-16B-A3B
Qwen · unsloth
Params16B
Context40K
Q4_K_M9.8 GB
QW
Qwen3 Yoyo V4 42B A3B Thinking TOTAL RECALL PKDick V
Qwen · mradermacher
Params42.4B
Context256K
Q4_K_M25.7 GB
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · diablomike20
Params8.95B
Context256K
Q4_K_M6.8 GB
QW
Qwen3.5 9B DS9 USS Defiant
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama3.1 8B PlumMath
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
Discoleo
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 Esper3 Reasoning Instruct 6B Brainstorm20x Enhanced E32 128k Ctx
Qwen · mradermacher
Params5.94B
Context128K
Q4_K_M3.6 GB
LA
Laguna S 2.1
Laguna · bartowski
Params118B
Context1024K
Q4_K_M71.8 GB
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
Samantha-qwen-0.5b-ptbr
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
LL
ADG CoT LLaMa3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
NO
North Mini Code 1.0
North · mradermacher
Params30.5B
Context488K
Q4_K_M18.6 GB
MU
G4 E4B Musica v1
Musica · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB