IQ2_M GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28351 models have a IQ2_M file. Sizes run from 2M to 1030B parameters. The longest trained context is 10240K tokens.
PA
Pantheon Rp 1.6.1 12b Nemo
Pantheon · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
LL
LLaMA2-13B-Psyfighter2
Llama · mradermacher
Params13B
Context4K
Q4_K_M7.9 GB
LL
Llama3-8B-Instruct-Replete-Adapted
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CH
Chaotic Harmony 24B
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
TE
TerminalHorizon 27B
Terminalhorizon · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
NE
Huihui NVIDIA Nemotron Nano 9B v2 Abliterated
Nemotron · mradermacher
Params8.89B
Context1024K
Q4_K_M6.5 GB
NO
Nontoxic PiVoT Bagel RP 34b i1
Nontoxic · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
PI
PiVoT MoE i1
Pivot · mradermacher
Params36B
Context32K
Q4_K_M21.8 GB
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
CO
Yi Coder 9B Chat
Coder · mradermacher
Params54.3B
Context128K
Q4_K_M33.0 GB
ZR
ZR1 1.5B
bartowski
Params1.78B
Context128K
Q4_K_M1.1 GB
LL
Llama 30b
Llama · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
LY
MN 12B Lyra v4
Lyra · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GR
Grug 27b v1.1
Grug · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
GP
Gpt Oss 20b Derestricted
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
LL
Llama 3.3 8B Instruct 128K Jbliterated
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
SE
SEX ROLEPLAY 3.2 1B i1
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
QW
X Coder RL Qwen3 8B
Qwen · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
LL
Llama3.2 24B A3B II Dark Champion INSTRUCT Heretic Abliterated Uncensored
Llama · mradermacher
Params18B
Context128K
Q4_K_M11.1 GB
AT
Atom 80b
Atom · mradermacher
Params80B
Context256K
Q4_K_M48.4 GB
NE
Nemotron H 47B Reasoning 128K
Nemotron · bartowski
Params47B
Context1024K
Q4_K_M28.2 GB
MI
Ministral 3 3B Reasoning UNCENSORED Heretic
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
QW
Qwen3.8 27B
Qwen · zugquants
Params26.9B
Context256K
Q4_K_M16.5 GB
YI
Capybara Tess Yi 34B 200K i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
OM
OmniDimen 2 20B Emotion
Omnidimen · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
IC
IceEspressoRPv2 7b i1
Iceespressorpv · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
AT
Athena v4 i1
Athena · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
GR
GritLM 8x7B KTO i1
Gritlm · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
LL
Llama-3-Groq-8B-Tool-Use
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB