IQ2_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28351 models have a IQ2_M file. Sizes run from 2M to 1030B parameters. The longest trained context is 10240K tokens.
IC
Iced-Lemon-Cookie-7B
Iced · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3 VL 2B Instruct Abliterated v1
Qwen · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
IC
IceTea21EnergyDrinkRPV13 dpo240 i1
Icetea · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mistral v0.2 Nexus Internal Knowledge Map 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB
AU
Aura 4B
Aura · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
ER
Erk 14B
Erk · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
LL
Llama-3.1-Argunaut-1-8B-HIRPO
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
MI
Mistral Nemo Instruct 2407 abliterated i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
ST
L3.1 Storniitova 8B i1
Storniitova · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
dolphin 2.9.4 llama3.1 8b i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
QW
Qwen3 VL 8B NSFW Caption V4.5
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
GP
Gpt Oss 20b RichardErkhov Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LO
LongWriter V 7B
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2-7B-Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
PE
Pelican1.0 VL 235B A22B FC
Pelican · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
MI
MissLizzy_7b_HF
Misslizzy · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
I2S Qwen3 8B Confidence
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CU
CursorCore QW2.5 7B i1
Cursorcore · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Polaris HighIQ THINKING
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
DA
Darwin 35B A3B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
LL
Phind CodeLlama 34B Python v1
Llama · mradermacher
Params33.7B
Context16K
Q4_K_M20.2 GB
QW
Qwen2.5 72b RP Ink
Qwen · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
QW
Qwen3 32B LoRA ECHO KK GRPO
Qwen · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen2.5 Godzilla Coder 51B 128k
Qwen · mradermacher
Params51B
Context128K
Q4_K_M30.7 GB
YI
Yi-1.5-9B-Chat
Yi · mradermacher
Params8.83B
Context4K
Q4_K_M5.3 GB
OM
OmniCoder Queen 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB