IQ4_XS GGUF models
Importance-matrix 4-bit quant, extra small. Small files with good quality for the size. 97368 models have a IQ4_XS file. Sizes run from 1M to 2450B parameters. The longest trained context is 102400K tokens.
NO
Nova-1.1-0.8B
Nova · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
S1
S1 VL 32B
mradermacher
Params32.8B
Context256K
Q4_K_M19.8 GB
FI
Fimbulvetr 40 i1
Fimbulvetr · mradermacher
Params10.7B
Context4K
Q4_K_M6.5 GB
LI
Lilith 31B v1.0
Lilith · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
MI
Infinity Instruct 7M Gen Mistral 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen3.5 9B Abliterated
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CH
Chaotic Order 24B V3
Chaotic · mradermacher
Params23.6B
Context128K
Q4_K_M14.3 GB
CH
chujiezheng Starling LM 7B beta ExPO
Chujiezheng · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
QW
Qwen3 2507 4B Instruct Haiku 4.5 Merged
Qwen · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
IR
Irene-RP-v2-7B
Irene · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
MiniMax M3
Minimax · bartowski
Params426B
Context1024K
Q4_K_M261.3 GB
LL
Hermes 3 Llama 3.1 70B
Llama · legraphista
Params70.6B
Context128K
Smallest15.3 GB
SE
Seed OSS 36B Instruct
Seed · bartowski
Params36.2B
Context512K
Q4_K_M21.8 GB
QW
Qwen3 0.6B Abliterated
Qwen · bartowski
Params596M
Context40K
Q4_K_M0.4 GB
AM
Amaretto 8B
Amaretto · mradermacher
Params8.49B
Context256K
Q4_K_M5.2 GB
GE
Gemma 4 31B It SDFT Heretic RP
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
QW
Qwen3 30B A3B ArliAI RpR v4 Fast
Qwen · mradermacher
Params30.5B
Context40K
Q4_K_M18.6 GB
SO
Solar Open 100B
Solar · mradermacher
Params103B
Context128K
Q4_K_M62.3 GB
RH
rho-math-1b-interpreter-v0.1
Rho · RichardErkhov
Params1.1B
Context2K
Q4_K_M0.7 GB
DI
DialFactSum ACU 8B
Dialfactsum · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
WI
Wizard Vicuna 30B Uncensored
Wizard · mradermacher
Params32.5B
Context2K
Q4_K_M19.6 GB
KA
Kadoe 4B
Kadoe · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
MI
UCLA AGI Mistral7B PairRM SPPO Iter3
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
MP
Mpt 7b Chat
Mpt · mradermacher
Params6.65B
Context2K
Q4_K_M4.3 GB
WI
Winterreise-m7
Winterreise · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
FA
Falcon
Falcon · mradermacher
Params41.8B
Context2K
Q4_K_M26.0 GB
OC
Occamy 1.0
Occamy · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
GL
Poe 8B GLM5 Opus4.6 Sonnet4.5 Kimi Grok Gemini 3 Pro Preview HERETIC
GLM · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
Llama 3.2 3B MoE 4Expert
Llama · mradermacher
Params9.55B
Context128K
Q4_K_M5.9 GB
MI
Ministral 3b instruct
Mistral · mradermacher
Params3.32B
Context128K
Q4_K_M2.0 GB