IQ2_XXS GGUF models

Importance-matrix 2-bit quant. Extreme compression with a large quality cost. 26647 models have a IQ2_XXS file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
ZA
Zawen v0.1 35B A3B
Zawen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
Roleplay
MI
MiniMax M2.7
Minimax · bartowski
Params230B
Context192K
Q4_K_M138.8 GB
GGUF
IN
InternLM2
InternLM · legraphista
Params19.9B
Context8K
Smallest4.5 GB
GGUF
CL
Clef Flash Heretic
Clef · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Vision
QW
GELab-Zero-4B-preview
Qwen · Mungert
Params4B
Context256K
Q4_K_M2.6 GB
Vision
QW
Huihui Qwen3 14B Abliterated v2
Qwen · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
DE
Deepseek Coder 6.7b Base
DeepSeek · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
QW
Qwen2.5 14B Instruct
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
PH
Phi 3 Medium 128k Instruct
Phi · bartowski
Params14B
Context128K
Q4_K_M8.6 GB
Coding
YI
Yi 34B 200K DARE megamerge v8 i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
PS
Psyonic Cetacean Ultra Quality 20b GGUF imat plus2
Psyonic · DavidAU
Params20B
Context4K
Q4_K_M12.0 GB
Roleplay
VE
Veloxy Titan 32B
Veloxy · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
CodingReasoningTool use
KO
Kolibri 1
Kolibri · bartowski
Params78.1B
Context256K
Q4_K_M49.8 GB
Reasoning
PY
Pyrex 8B Instruct Uncensored i1
Pyrex · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
CodingTool use
AS
Asmodeus 24B v3
Asmodeus · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
HO
K2 Horizon 32B Heretic
Horizon · mradermacher
Params34.8B
Context512K
Q4_K_M21.1 GB
Coding
YI
ChatAllInOne-Yi-34B-200K-V1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M20.7 GB
GGUF
QW
Qwen3.8-2.4T-A95B
Qwen · unsloth
Params2450B
Context256K
Smallest397.3 GB
GGUF
GL
Glistening Gem 31B v2.1
Glistening · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
CO
Yi Coder 9B Chat
Coder · mradermacher
Params8.83B
Context128K
Q4_K_M5.3 GB
Coding
SH
Shadow Siren 14B Pruned
Shadow · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
QW
Huihui Qwen3.5 4B Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GGUF
GE
Wanabi Gemma4 31B
Gemma · kawaimasa
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
LL
OrionStar-Yi-34B-Chat-Llama
Llama · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
QW
Huihui Qwen3.6 27B Abliterated
Qwen · mradermacher
Params27B
Context256K
Q4_K_M16.5 GB
GGUF
DA
Darwin 36B Opus
Darwin · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Reasoning
NE
Nemotron 3 Nano 30B A3B
Nemotron · bartowski
Params31.6B
Context1024K
Q4_K_M24.7 GB
Coding
QW
Qwen3.6 40B Fable Fusion 6 Core Deckard Eleanor Heretic Uncensored NM DAU NEO MAX MTP
Qwen · DavidAU
Params39.1B
Context256K
Q4_K_M25.9 GB
CodingReasoningRoleplay
OL
Olmo 3.1 32B Instruct
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
GGUF
DE
Deepseek-Prover-V2-7B
DeepSeek · unsloth
Params6.91B
Context32K
Q4_K_M4.2 GB
GGUF

Other quants

Keep browsing