IQ2_XXS GGUF models

Importance-matrix 2-bit quant. Extreme compression with a large quality cost. 26647 models have a IQ2_XXS file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.6 35B A3B REAM 160 ru agent
Qwen · WaveCut
Params23.1B
Context256K
Q4_K_M14.4 GB
GGUF
AY
aya-23-8B
Aya · legraphista
Params8B
Context8K
Smallest2.2 GB
GGUF
AR
ArrowPro-7B-KillerWhale
Arrowpro · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 32B VL GLM 4.7 Flash HI16 Heretic Uncensored Thinking
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
ReasoningRoleplayVision
GL
GLM 5.3 Flash BF16
GLM · avar6
Params321B
Context—
Smallest0.5 GB
GGUF
QW
Qwen3.5 27B Abliterated Ko
Qwen · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
FU
FusionNet_7Bx2_MoE_14B
Fusionnet · mradermacher
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
PY
Pythia 6.9b
Pythia · mradermacher
Params6.86B
Context2K
Q4_K_M4.4 GB
GGUF
LL
DarkIdol Llama 3.1 8B Instruct 1.0 Uncensored i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Roleplay
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
GGUF
NO
Novaeus Promptist 7B Instruct i1
Novaeus · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
MO
MoNeuTrix MoE 4x7B i1
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
IR
Irene-RP-v2-7B_128k
Irene · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Roleplay
LL
Llama 3.2 1B Instruct
Llama · legraphista
Params1.24B
Context128K
Smallest0.4 GB
GGUF
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
LL
Llama Leonida v2
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF
SZ
SzilviaB Daredevil LongWriter 8B abliterated i1
Szilviab · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 32B VL Instruct Polaris HI16 Heretic Uncensored
Qwen · mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
RoleplayVision
MI
Mahou-1.2-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
RA RFT Qwen2.5 VL 7B
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LF
LFM2.5 350M RLCD
Lfm · NANI-Nithin
Params354M
Context125K
Q4_K_M0.2 GB
GGUF
HE
NousResearch.Hermes 4 405B
Hermes · DevQuasar-13
Params405B
Context128K
Q4_K_M243.1 GB
Tool use
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
Vision
QW
ColdBrew Qwen3.5 CharThink Base
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
LL
Hermes 2 Pro Llama 3.1 70B i1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
Tool use
LL
Vikhr-Llama-3.2-1B-instruct
Llama · Vikhrmodels
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
MP
mpt 7b i1
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
GGUF
QW
Qwen3-32B-128K
Qwen · unsloth
Params32.8B
Context128K
Q4_K_M19.8 GB
GGUF
QW
Qwen3 Embedding 0.6B
Qwen · PeterAM4
Params596M
Context32K
Q4_K_M0.4 GB
Embedding
CO
ContextualKunoichi KTO 7B i1
Contextualkunoichi · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing