IQ3_XS GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 46199 models have a IQ3_XS file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
IC
Iced-Lemon-Cookie-7B
Iced · backyardai
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
Qwen3 VL 2B Instruct Abliterated v1
Qwen · prithivMLmods
Params1.72B
Context256K
Q4_K_M1.1 GB
Vision
MI
Mirai 70B 0.1 Public Alpha
Mirai · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
MI
Ministral 3 8B Base 2512
Mistral · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
GGUF
IC
IceTea21EnergyDrinkRPV13 dpo240 i1
Icetea · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
YI
Yi-34Bx2-MoE-60B-DPO
Yi · mradermacher
Params60.8B
Context195K
Q4_K_M36.7 GB
GGUF
RE
ReflectionCoder DS 33B
Reflectioncoder · RichardErkhov
Params33.3B
Context16K
Q4_K_M19.9 GB
Coding
JO
JOSIExMistral 7B Instruct v0.2
Josiexmistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
MI
Mistral v0.2 Nexus Internal Knowledge Map 7B i1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
Step 3.5 Flash REAP 149B A11B i1
Step · mradermacher
Params149B
Context256K
Q4_K_M89.9 GB
GGUF
AU
Aura 4B
Aura · bartowski
Params4.51B
Context128K
Q4_K_M2.8 GB
RoleplayTool use
LL
Bio Medical Llama 3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CR
Crunchy onion
Crunchy · mradermacher
Params46.7B
Context32K
Q4_K_M28.4 GB
GGUF
ER
Erk 14B
Erk · mradermacher
Params14.8B
Context40K
Q4_K_M9.0 GB
GGUF
LL
Llama-3.1-Argunaut-1-8B-HIRPO
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
MI
Mistral Nemo Instruct 2407 abliterated i1
Mistral · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
ST
L3.1 Storniitova 8B i1
Storniitova · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
LL
dolphin 2.9.4 llama3.1 8b i1
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Coding
QW
Qwen3 VL 8B NSFW Caption V4.5
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
Vision
GP
Gpt Oss 20b RichardErkhov Heresy
gpt-oss · mradermacher
Params20.9B
Context128K
Q4_K_M15.8 GB
GGUF
PY
Pythia 160m
Pythia · mradermacher
Params162M
Context2K
Q4_K_M0.1 GB
GGUF
LO
LongWriter V 7B
Longwriter · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
QW
Qwen2-7B-Instruct
Qwen · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
PE
Pelican1.0 VL 235B A22B FC
Pelican · mradermacher
Params235B
Context256K
Q4_K_M142.2 GB
Vision
MI
MissLizzy_7b_HF
Misslizzy · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
QW
I2S Qwen3 8B Confidence
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen2.5 Lumen 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
LL
Llama-3-8B-Magpie-Pro-MT-UltraDPO2
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
CU
CursorCore QW2.5 7B i1
Cursorcore · mradermacher
Params7.61B
Context32K
Q4_K_M4.7 GB
Coding
SQ
OG SQL 7B
Sql · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
GGUF

Other quants

Keep browsing