IQ3_XXS GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 28129 models have a IQ3_XXS file. Sizes run from 2M to 2450B parameters. The longest trained context is 10240K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-4-E4B-It
Gemma · unsloth
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GL
orcarouter GLM 5.3 Flash Uncensored
GLM · BoldingBuilds
Params321B
Context1024K
Smallest97.1 GB
Vision
GE
Gemma-4-E2B-It
Gemma · unsloth
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Vision
QW
Swift 1.5 Qwen3.8 Flash Next GSQ RCO abliterated
Qwen · SC117
Params177B
Context256K
Smallest0.9 GB
GGUF
OR
Ornith-1.0-9B
Ornith · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
Vision
GL
GLM 5.3
GLM · unsloth
Params754B
Context1024K
Smallest216.7 GB
GGUF
QW
Huihui Qwen3.8 Flash Next abliterated
Qwen · huihui-ai
Params177B
Context256K
Smallest68.2 GB
ReasoningVision
TH
Thomson 1.0 Small
Thomson · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
OR
Tiel Coder 35B A3B
Ornith · peculiar-ragdoll
Params34.7B
Context256K
Smallest0.2 GB
GGUF
QW
Qwen3.8 Flash Next abliterated GSQ RCO Strata
Qwen · alesha-pro
Params—
Context—
Smallest0.0 GB
GGUF
KA
KAT Coder V2.5 Dev
Kat · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Coding
QW
Qwen3.8 27B
Qwen · bartowski
Params27.3B
Context256K
Q4_K_M17.4 GB
Vision
QW
Huihui Qwen3.8 Flash Next abliterated v2
Qwen · huihui-ai
Params177B
Context—
Smallest1.2 GB
ReasoningVision
GE
Gemma-4-31B-It
Gemma · unsloth
Params30.7B
Context256K
Q4_K_M18.3 GB
Vision
QW
Qwen3.5-0.8B
Qwen · unsloth
Params752M
Context256K
Q4_K_M0.5 GB
Vision
QW
Qwen-Agentworld-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
GGUF
QW
Qwen2.5-Vl-7B-Instruct
Qwen · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
LI
Ling 3.0 Tiny
Ling · bloomer010
Params7.89B
Context128K
Q4_K_M4.8 GB
Coding
GL
Glm-4.7-Flash
GLM · unsloth
Params30B
Context198K
Q4_K_M18.3 GB
GGUF
NO
North-Mini-Code-1.0
North · unsloth
Params30.5B
Context488K
Q4_K_M19.2 GB
Coding
LI
Ling 3.0 Flash
Ling · AtomicChat
Params124B
Context128K
Q4_K_M75.3 GB
ReasoningTool use
DE
DeepSeek V4.1 Flash 1017
DeepSeek · unsloth
Params748B
Context1024K
Smallest8.0 GB
GGUF

Other quants

Keep browsing