IQ3_XS GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 46199 models have a IQ3_XS file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.8 27B Uncensored HauhauCS Aggressive MTP
Qwen · HauhauCS
Params30B
Context—
Smallest0.9 GB
GGUF
QW
Qwen3.8 27B
Qwen · byteshape
Params27.3B
Context256K
Smallest8.8 GB
Vision
QW
MiMo V2.6 Distill Qwen 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
CodingTool useVision
QW
Qwen2.5 32B Instruct
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
GGUF
QW
Qwen3.8-27B
Qwen · agentionai
Params27.3B
Context256K
Q4_K_M16.5 GB
ReasoningTool useVision
CY
Cyber Ornith 1.5 9B OBLITERATED
Cyber · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
OC
Occamy 1.0
Occamy · Accio-Lab
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
QW
Swift Qwen3.8 27b
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M18.0 GB
ReasoningVision
LL
Meta Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
TH
Thomson 1.0 Small
Thomson · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
KA
KAT Coder V2.5 Dev
Kat · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Coding
QW
Qwen3.8 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
MI
MiniCPM V 4.7 35B A3B
MiniCPM · openbmb
Params34.7B
Context256K
Q4_K_M21.2 GB
ReasoningTool useVision
QW
Qwen2.5 7B Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
Swift 1.5 Qwen3.8 27B
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M17.4 GB
ReasoningVision
QW
Qwen3.5 9B
Qwen · bartowski
Params9.2B
Context256K
Q4_K_M6.2 GB
Vision
QW
Qwen3.6 35B A3B
Qwen · bartowski
Params35.5B
Context256K
Q4_K_M22.3 GB
Vision
QW
Qwen2.5 14B Instruct
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
QW
Swift 1.5 Qwen3.8 Flash Next
Qwen · ukisai
Params177B
Context256K
Q4_K_M119.6 GB
ReasoningVision
QW
Qwen3.8 27B Uncensored
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningTool useVision
QW
Qwen3 4B
Qwen · bartowski
Params4B
Context32K
Q4_K_M2.5 GB
GGUF
TA
UI-TARS-1.5-7B
Tars · Mungert
Params7.6B
Context125K
Q4_K_M4.8 GB
Vision
GR
Grug 12B
Grug · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
CodingReasoningVision
DE
DeepSeek R1 Distill Qwen 7B
DeepSeek · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
Reasoning
QW
Qwen3.5 4B
Qwen · bartowski
Params4.33B
Context256K
Q4_K_M3.0 GB
Vision
GE
Gemma 4 E2B It
Gemma · bartowski
Params4.65B
Context128K
Q4_K_M3.5 GB
Vision
QW
Qwen2.5 0.5B Instruct
Qwen · bartowski
Params494M
Context32K
Q4_K_M0.4 GB
GGUF
MI
MiniCPM V 4.7 1B
MiniCPM · openbmb
Params1.01B
Context256K
Q4_K_M0.7 GB
ReasoningTool useVision
QW
Qwen3 0.6B
Qwen · bartowski
Params752M
Context32K
Q4_K_M0.5 GB
GGUF

What is IQ3_XS?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. On average it stores about 3.3 bits per weight, so a IQ3_XS file is roughly 21% of the size of the same model in 16-bit. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

46,199 models have a IQ3_XS file on ggufmodels.com, and those files range from 0.0 to 466.6 GB. The most downloaded are Qwen3.8 27B Uncensored HauhauCS Aggressive MTP, Qwen3.8 27B and MiMo V2.6 Distill Qwen 9B. For a longer explanation of every quant type, read GGUF quantization explained.

Frequently asked questions

What is IQ3_XS in GGUF?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. It averages about 3.3 bits per weight.

Should I use IQ3_XS?

A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

How big is a IQ3_XS file?

IQ3_XS files on this site range from 0.0 to 466.6 GB, depending on the model. As a rule of thumb it is about 21% of the 16-bit size.

Other quants

Keep browsing