IQ3_XS GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 46199 models have a IQ3_XS file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
MathSmith HC Qwen3 8B Qwen2_5 32B ShortCoT
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
KU
KURE v3
Kure · mradermacher
Params1.14B
Context256K
Q4_K_M0.7 GB
GGUF
DR
Dream v0 Instruct 7B
Dream · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
MI
mrm8488 mistral 7b ft AgentInstruct
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RI
Rivermind Lux 12B v1
Rivermind · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
PH
Phi 2 Hyper
Phi · mradermacher
Params2.78B
Context2K
Q4_K_M1.7 GB
GGUF
UN
una xaberius 34b v1beta i1
Una · mradermacher
Params34.4B
Context4K
Q4_K_M20.7 GB
GGUF
NU
Nutopia 7B
Nutopia · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
LL
sheep duck llama 2 70b v1.1
Llama · mradermacher
Params69B
Context4K
Q4_K_M41.4 GB
GGUF
QW
Qwen3 Coder Next Base
Qwen · mradermacher
Params79.7B
Context256K
Q4_K_M48.5 GB
Coding
QW
OpenChat 3.5 7B Qwen v2.0
Qwen · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
YI
RpBird Yi 34B 200k i1
Yi · mradermacher
Params34.4B
Context195K
Q4_K_M21.2 GB
GGUF
MI
OpenHermes-2.5-Mistral-7B-x2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
Tool use
MI
Mahou-1.2-mistral-7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
DE
DeepSeek-Coder-V2-Lite-Base
DeepSeek · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
Coding
MI
MistralAI Magistral Small 2507 Heretic Uncensored
Mistral · mradermacher
Params23.6B
Context40K
Q4_K_M14.3 GB
ReasoningRoleplay
QW
Deductive Reasoning Qwen 32B
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Reasoning
QW
Qwen2.5 Coder 1.5B Instruct Abliterated
Qwen · mradermacher
Params1.78B
Context32K
Q4_K_M1.1 GB
CodingTool use
MA
Magnum Blackout Ataraxy 2 9b i1
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IN
Internlm2 Math Plus 1_8b
InternLM · mradermacher
Params1.89B
Context8K
Q4_K_M1.2 GB
GGUF
AR
Artemis 31B v1.1 Heretic
Artemis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
QW
Qwen3.8 27B
Qwen · Distillio
Params27.3B
Context256K
Q4_K_M17.8 GB
Vision
LO
Loki v5.1 i1
Loki · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
OR
Ornstein Hermes 3.6 27b SABER
Ornstein · mradermacher
Params26.9B
Context256K
Q4_K_M16.5 GB
ReasoningTool use
NE
Nemotron Cascade 2 30B A3B Heretic Ara Uncensored
Nemotron · mradermacher
Params31.6B
Context1024K
Q4_K_M24.5 GB
Reasoning
RE
Rex Frame 3B
Rex · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
Vision
MI
Ministral 8B Instruct 2410
Mistral · bartowski
Params8B
Context32K
Q4_K_M4.9 GB
GGUF
DO
Dolphin v2
Dolphin · prithivMLmods
Params3.1B
Context125K
Q4_K_M1.9 GB
CodingVision
SO
T3Q ko solar dpo v3.0
Solar · mradermacher
Params10.7B
Context4K
Q4_K_M6.6 GB
GGUF
MI
dolphin-2.9.1-mixtral-1x22b
Mistral · legraphista
Params22.2B
Context64K
Smallest4.8 GB
CodingTool use

Other quants

Keep browsing