IQ2_XS GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 26336 models have a IQ2_XS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.
TE
Tessera 27B B CJK
Tessera · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
NA
Nammu_72B_Base
Nammu · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
IN
INTELLECT 1
Intellect · mradermacher
Params10.2B
Context8K
Q4_K_M6.2 GB
GE
GracieRP freefallenLora Gemma2 Inst 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
ST
Stellar Pro 9B
Stellar · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
LL
Llama 3.3 70B ArliAI RPMax v1.4
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
HE
G Health 32B Base
Health · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
QW
Qwen3.5 9B RolePlay Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 Next 80B A3B Instruct
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
PY
Pythia 2.8b
Pythia · mradermacher
Params2.78B
Context2K
Q4_K_M1.8 GB
LL
yo-Llama-3-8B-Instruct
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
CH
chronos 33b i1
Chronos · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
CE
L3.1 Celestial Stone 2x8B i1
Celestial · mradermacher
Params13.7B
Context128K
Q4_K_M8.3 GB
QW
Qwen2.5 Coder 32B Instruct
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
VeriCoder_Gemma12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
OP
OpenChat 3.5 7B Starling v2.0
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
LL
Tess-2.0-Llama-3-70B-v0.2
Llama · mradermacher
Params70.6B
Context8K
Q4_K_M42.5 GB
DE
deepseek-coder-1.3B-kexer
DeepSeek · bartowski
Params1.35B
Context16K
Q4_K_M0.9 GB
AN
AngelSlayer 12B Unslop Mell RPMax DARKNESS v3 i1
Angelslayer · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
QW
Qwythos 9B Claude Mythos Uncensored Abliterated 1M
Qwythos · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
QW
Qwen3.8 27B Leimroth3
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
QW
QwQ 32B Preview
Qwen · mradermacher
Params32.8B
Context32K
Q4_K_M19.9 GB
GE
Storyteller Gemma3 27B
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
DE
FuseO1 DeepSeekR1 QwQ SkyT1 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
LL
Dobby Mini Unhinged Plus Llama 3.1 8B i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
UM
CENTAURUS Engine v1 i1
Uma · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
WI
Wicked Tutu 31B v2.0
Wicked · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B FT It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
NI
L3.1 Niitorm 8B DPO t0.0001 i1
Niitorm · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB