IQ2_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28351 models have a IQ2_M file. Sizes run from 2M to 1030B parameters. The longest trained context is 10240K tokens.
CO
Yi Coder 1.5B Chat
Coder · bartowski
Params1.48B
Context128K
Q4_K_M1.0 GB
NO
North Mini Code 1.0
North · bartowski
Params30.5B
Context488K
Q4_K_M18.7 GB
PH
Phi 3 mini 4k instruct update2024 07 03 IMat
Phi · legraphista
Params3.82B
Context4K
Smallest0.8 GB
AE
AesCode 32B
Aescode · bartowski
Params32.8B
Context256K
Q4_K_M20.5 GB
DA
Darwin 27B RSI
Darwin · bartowski
Params27B
Context256K
Q4_K_M17.2 GB
NE
Nex N2.5 mini
Nex · abenzerps
Params34.7B
Context256K
Q4_K_M21.2 GB
SE
Sexpedition MS3.2 24B
Sexpedition · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Huihui Qwen3 8B Abliterated v2
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GE
Gemma 4 26B A4B It Uncensored
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
AR
Artemis 31B v1.1
Artemis · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
Qwen3 14B ARPO DeepSearch
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
NE
Nemotron3-Nano-4B-Uncensored-HauhauCS-Aggressive
Nemotron · HauhauCS
Params3.97B
Context1024K
Q4_K_M2.8 GB
TO
tokyotech llm Swallow MS 7b instruct v0.1
Tokyotech · mmnga
Params7.33B
Context4K
Q4_K_M4.4 GB
XO
Xor 26B A4B
Xor · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
PR
Promethean Dawn 26B A4B
Promethean · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen3.5 9B Cold Fusion GAIN v1.0 Uncensored Heretic NEO MAX Imatrix
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
EM
Source Hf Embeddinggemma 2
Embeddinggemma · ngquocvinh
Params271M
Context256K
Q4_K_M0.2 GB
LF
LFM2.5 24B A2B Uncensored Heretic
Lfm · mradermacher
Params24B
Context128K
Q4_K_M14.5 GB
WI
WizardLM 30B Uncensored Guanaco SuperCOT 30b i1
Wizardlm · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
JA
Jais-3-32B
Jais · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
QW
Qwen2.5 VL 32B Instruct Abliterated
Qwen · mradermacher
Params32.8B
Context125K
Q4_K_M19.9 GB
QW
JetBrains Qwen3.8 3.6 27B Blend
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
DE
Deepseek-V3.2
DeepSeek · unsloth
Params670B
Context160K
Q4_K_M405.4 GB
SA
Sabi Noema
Sabi · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
OL
OLMo 2 1124 13B Instruct
OLMo · bartowski
Params13.7B
Context4K
Q4_K_M8.4 GB
QW
Qwen2 VL 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
ER
Ernie-4.5-21B-A3B-Pt
Ernie · unsloth
Params21.8B
Context128K
Q4_K_M13.3 GB
MI
Devstral-2-123B-Instruct-2512
Mistral · unsloth
Params125B
Context256K
Q4_K_M74.9 GB
PH
Phi 3.1 mini 4k instruct
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
HE
HERO 35B A3B
Hero · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB