IQ2_XXS GGUF models

Importance-matrix 2-bit quant. Extreme compression with a large quality cost. 26647 models have a IQ2_XXS file. Sizes run from 2M to 2780B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
AL
ALIA 40b Fc 2605
Alia · mradermacher
Params40.4B
Context160K
Q4_K_M24.6 GB
Tool use
GR
Grok Oss Revenant 8B
Grok · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 26B Roleplay v2 Merged
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
JA
japanese-stablelm-2-instruct-1_6b
Japanese · mmnga
Params1.64B
Context4K
Q4_K_M1.0 GB
GGUF
PO
Polar 14B
Polar · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
ReasoningTool use
LL
Meta llama_Meta Llama 3 8B Instruct
Llama · ThomasBaruzier
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dolphin3.0 Llama3.1 8B abliterated
Llama · Testprofile1
Params8.03B
Context128K
Q4_K_M4.9 GB
GGUF
QW
Huihui Qwen3 VL 30B A3B Instruct Abliterated
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
Vision
CA
Carnice V2 27b
Carnice · bartowski
Params27B
Context256K
Q4_K_M17.5 GB
Tool use
PH
Phenom 12B 0.1 i1
Phenom · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
GP
GPT OSS Swallow 20B SFT v0.1
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
Coding
GL
GLM 4.7 Flash REAP 23B A3B i1
GLM · mradermacher
Params23B
Context198K
Q4_K_M13.9 GB
GGUF
NE
Nekomata 7b Instruction
Nekomata · mradermacher
Params7.72B
Context32K
Q4_K_M4.9 GB
GGUF
QW
dolphin-2.9.3-qwen2-1.5b
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
CodingTool use
MY
Mythos 9b Unhinged Heretic
Mythos · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GR
GRiP i1
Grip · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
Reasoning
QW
Openbuddy Qwen2.5Llamaify 14b v23.3 200k
Qwen · mradermacher
Params14.8B
Context195K
Q4_K_M9.0 GB
GGUF
MA
MAmmoTH2-8x7B-Plus
Mammoth · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
GE
Gemma 4 The Deckards Brain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
AL
AlphaMonarch laser i1
Alphamonarch · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
TE
Tessera 27B B CJK
Tessera · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
NA
Nammu_72B_Base
Nammu · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
Tool use
IN
INTELLECT 1
Intellect · mradermacher
Params10.2B
Context8K
Q4_K_M6.2 GB
GGUF
GE
GracieRP freefallenLora Gemma2 Inst 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ST
Stellar Pro 9B
Stellar · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
LL
Llama 3.3 70B ArliAI RPMax v1.4
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
HE
G Health 32B Base
Health · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
QW
Qwen3.5 9B RolePlay Merged
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
QW
Qwen3 Next 80B A3B Instruct
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.4 GB
Tool use
QW
MiMo V2.6 Distill Qwen 9B Ablitrated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Tool use

Other quants

Keep browsing