IQ2_XS GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 26336 models have a IQ2_XS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 9B Heretic Uncensored
Qwen · marafx2007
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
LL
Llama3.1 MOE 4X8B Gated IQ Multi Tier Deep Reasoning 32B
Llama · mradermacher
Params24.9B
Context128K
Q4_K_M15.2 GB
ReasoningRoleplayTool use
FA
Faithful_Thinking_with_Image
Faithful · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
AR
AREX Base
Arex · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
ER
Erk 32B
Erk · mradermacher
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
LL
Collaiborator MEDLLM Llama 3 8B v1 i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen3 4B Abliterated TIES
Qwen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen3.5 13B Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params12.4B
Context256K
Q4_K_M7.7 GB
ReasoningRoleplay
BE
Beam 1.0 501B A23B
Beam · bartowski
Params501B
Context1024K
Q4_K_M314.5 GB
CodingReasoningTool use
EV
L3-8B-Everything-COT
Everything · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LE
Lexi Coder v5.1
Lexi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Coding
GE
Gemma 4 Gemsicle 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
LL
llama-3-tulu-2-8b
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
WA
Wayfarer 2 12B Absolute Heresy
Wayfarer · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Models Qwen Qwen2.5 32B Instruct
Qwen · MaziyarPanahi
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
GP
Gpt Oss 20b
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
SM
Smart Commit 1.5b v0.3
Smart · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
KL
Klyrune 2B Coder
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
MI
Mistral Nemo Prism 12B
Mistral · bartowski
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
SI
SIREN 3B
Siren · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
RO
Roleplay 9B lora 800 porn i1
Roleplay · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
KI
Kiwen1.1 27B
Kiwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningVision
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
NE
Nemo Gutenberg 12b v1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Dolphin3.0 Mistral 24B
Mistral · rax4901
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingTool use
QW
Qwen3 Stargate SG1 Uncensored Abliterated 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoning
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Other quants

Keep browsing