IQ3_XS GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 46199 models have a IQ3_XS file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
MI
zephyr-orpo-141b-A35b-v0.1
Mistral · bartowski
Params141B
Context64K
Q4_K_M85.6 GB
QW
Qwen3 Coder 30B A3B Instruct SOTA
Qwen · CISCai
Params30.5B
Context—
Smallest0.1 GB
MO
G4 Moonlight Dusk 26B A4B Heretic
Moonlight · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
QW
Qwen3 30B A3B Claude 4.5 Opus High Reasoning 2507 ABLITERATED UNCENSORED V2
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
OL
OLMo 1B 0724 Hf
OLMo · mradermacher
Params1.28B
Context4K
Q4_K_M0.8 GB
LA
Laguna XS 2.1
Laguna · mradermacher
Params33.4B
Context256K
Q4_K_M20.3 GB
ER
ERNIE 21B A3B Claude 4.5 High OPUS Thinking
Ernie · mradermacher
Params21.8B
Context128K
Q4_K_M13.2 GB
WI
WizardCoder 15B V1.0
Wizardcoder · mradermacher
Params15.8B
Context8K
Q4_K_M10.1 GB
MI
Midnight-Rose-70B-v2.0.3
Midnight · backyardai
Params69B
Context4K
Q4_K_M41.4 GB
KA
KAT Coder V2.5 Dev
Kat · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
NA
Nanbeige4.3 33B
Nanbeige · mradermacher
Params33.1B
Context512K
Q4_K_M20.1 GB
SH
OS Shepherd 9B
Shepherd · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
CO
commandr
Command R · DavidAU
Params35B
Context128K
Q4_K_M21.5 GB
GL
LongWriter Glm4 9b
GLM · bartowski
Params9.4B
Context1024K
Q4_K_M6.3 GB
QW
Qwen3.5 35B A3B Uncensored Heretic
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
PY
Pythia 1.4b
Pythia · mradermacher
Params1.41B
Context2K
Q4_K_M0.9 GB
GE
Gemma2 Gutenberg Doppel 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
IC
IceBlendedLatteRP-7b
Iceblendedlatterp · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
CO
Concept 7b V1 Full
Concept · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
SO
Sorjin1.1 7B Instruct
Sorjin · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Unredacted MAX
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen3 30B A3B Thinking 2507 FT
Qwen · mradermacher
Params30.5B
Context256K
Q4_K_M18.6 GB
QW
Qwen3.5 35B A3B Base
Qwen · mradermacher
Params34.7B
Context256K
Q4_K_M21.2 GB
HO
K2 Horizon 0.9B
Horizon · NANI-Nithin
Params1.08B
Context128K
Q4_K_M0.7 GB
LL
Hermes 3 Llama 3.1 70B
Llama · mradermacher
Params70.6B
Context128K
Q4_K_M42.5 GB
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
EI
Einstein-v4-7B
Einstein · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
IN
Internlm3 8b Instruct
InternLM · bartowski
Params8.8B
Context32K
Q4_K_M5.4 GB
CI
Cirque 12B
Cirque · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
LL
Meta-Llama-3-8B-Instruct
Llama · qwp4w3hyb
Params8B
Context8K
Q4_K_M4.9 GB