IQ4_XS GGUF models

Importance-matrix 4-bit quant, extra small. Small files with good quality for the size. 97368 models have a IQ4_XS file. Sizes run from 1M to 2450B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
TI
TimeCrystal l2 13B i1
Timecrystal · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
Roleplay
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
GGUF
QW
Qwen3.5 9B Heretic
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
QW
Qwopus3.8 27B Flash V2 Apostate Uncensored
Qwopus · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
Vision
MO
MolOptAgent 7B
Moloptagent · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
YI
dolphin-2_2-yi-34b
Yi · mradermacher
Params34.4B
Context16K
Q4_K_M20.7 GB
GGUF
KO
Koa Express 31B Qat
Koa · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningTool use
GL
GLM 4.7 Flash Claude Opus 4.5 High Reasoning Distill
GLM · TeichAI
Params30B
Context198K
Q4_K_M18.1 GB
Reasoning
GR
Granite 20b Code Base R1.1
Granite · RichardErkhov
Params20B
Context8K
Q4_K_M12.8 GB
CodingReasoning
WI
models--microsoft--WizardLM-2-8x22B
Wizardlm · MaziyarPanahi
Params141B
Context64K
Q4_K_M85.6 GB
GGUF
GE
Gemma 4 26B A4B It Heretic
Gemma · nohurry
Params25.2B
Context256K
Q4_K_M16.9 GB
CodingVision
WI
WizardCoder 15B V1.0 i1
Wizardcoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
Coding
WI
Wicked Stuff 12B
Wicked · ReadyArt
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
SE
SEX_ROLEPLAY.v4 3.2 1B
Sex · mradermacher
Params1.5B
Context128K
Q4_K_M1.0 GB
RoleplayTool use
LL
Llama 3.3 70B Instruct ablated
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
GGUF
GE
Gemma 4 E2B
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma 4 31B Abliterated Uncensored
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
QW
Kataguru Qwen3.8 27B Titan v3.2
Qwen · kataguru
Params26.9B
Context256K
Smallest11.2 GB
ReasoningTool useVision
MI
Mimo-Vl-7B-Rl
Mimo · unsloth
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · Unrestricted
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
FI
Fimbulvetr-11B-v2.1-16K
Fimbulvetr · mradermacher
Params10.7B
Context16K
Q4_K_M6.5 GB
GGUF
FL
flint
Flint · terelabs
Params39.8B
Context256K
Q4_K_M25.0 GB
ReasoningTool use
QW
Qwen3.8 Whittle MoE 27B A17.8B
Qwen · mradermacher
Params27B
Context256K
Q4_K_M17.4 GB
GGUF
QW
Qwen3.8 27B Humanlike Chat 2.0
Qwen · mradermacher
Params27.3B
Context256K
Q4_K_M16.8 GB
RoleplayTool use
SE
SenseNova 6.8 Code2Video MTP
Sensenova · Abiray
Params27.3B
Context256K
Q4_K_M18.5 GB
ReasoningTool useVision
QW
Qwen3.8 27B Uncensored
Qwen · jaromer
Params27.3B
Context256K
Q4_K_M16.5 GB
GGUF
QW
Qwen3.8 9B Distill SLERP F451 Pro Writer Uncensored
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
RoleplayVision
CO
C4Ai Command R Plus 08 2024
Command R · bartowski
Params104B
Context128K
Q4_K_M62.8 GB
GGUF
CL
Clef-Flash
Clef · turintech
Params9.08B
Context256K
Smallest3.6 GB
ReasoningTool use
HU
Huihui Ornith 1.5 9B Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF

Other quants

Keep browsing