IQ2_XS GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 26336 models have a IQ2_XS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
QW
Aurbliterated_Qwen2_7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
ST
STARK WEB 12B v1.7
Stark · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ZW
ZwZ 7B i1
Zwz · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen2.5 4x7B Quad Coder Instruct 30B 128k Ctx
Qwen · mradermacher
Params30.4B
Context128K
Q4_K_M18.5 GB
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
MI
Mixtral_7Bx4_MOE_24B
Mistral · mradermacher
Params24.2B
Context32K
Q4_K_M14.6 GB
LL
Llama 3.1 70B ArliAI RPMax v1.3
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
HE
HER 32B
Her · mradermacher
Params32.8B
Context128K
Q4_K_M19.8 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GR
Huihui Granite 4.1 30b Abliterated
Granite · mradermacher
Params28.9B
Context128K
Q4_K_M17.5 GB
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
LL
models--MaziyarPanahi--Llama-3-8B-Instruct-v0.10
Llama · MaziyarPanahi
Params8B
Context8K
Q4_K_M4.9 GB
VE
UI Venus Navi 72B
Venus · mradermacher
Params72.7B
Context125K
Q4_K_M47.4 GB
LL
Bio Medical MultiModal Llama 3 8B V1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3.8 27B GSQ RCO
Qwen · Fix-AI
Params26.9B
Context256K
Smallest0.0 GB
NI
Ninja v1 NSFW
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
KI
Huihui Kimi Linear 48B A3B Instruct Abliterated
Kimi · therickcain
Params49.1B
Context1024K
Q4_K_M29.7 GB
BL
Blue-Orchid-2x7b
Blue · mradermacher
Params12.9B
Context8K
Q4_K_M7.8 GB
MI
MiniMax M2.7
Minimax · mradermacher
Params230B
Context192K
Q4_K_M138.3 GB
DE
Qwen3 14B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
AE
aegolius acadicus 34b v3 i1
Aegolius · mradermacher
Params35.4B
Context32K
Q4_K_M21.4 GB
KO
koishi 8x7b qlora i1
Koishi · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
YI
Yi-1.5-6B-Chat
Yi · mradermacher
Params6.06B
Context4K
Q4_K_M3.7 GB
QW
Qwen3.5 40B Holodeck Claude Deckard Picard Heretic
Qwen · mradermacher
Params39.1B
Context256K
Q4_K_M23.9 GB
QW
Qwen2.5 2X7B Coder Soar Qwen Coder Instruct OlympicCoder 19B
Qwen · mradermacher
Params19B
Context32K
Q4_K_M11.6 GB
GE
Gemma 4 Sphinsikus Chronist V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB