IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
QW
Qwen3.5-9B
Qwen · Fix-AI
Params8.95B
Context256K
Q4_K_M5.7 GB
QA
QAZTECH Azure Engineer 8B
Qaztech · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Llama-3-8B-Instruct-64k
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
TR
Triangulum 10B It
Triangulum · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
QW
QwQ 32B ArliAI RpR v4
Qwen · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
YI
Yi 34Bx2 MOE 200K
Yi · mradermacher
Params61B
Context195K
Q4_K_M37.2 GB
LL
DarkIdol Llama 3.1 8B Instruct 1.3 Uncensored
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
RO
RoboInter VLM
Robointer · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
HA
Harvey 9B
Harvey · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 7B Instruct
Qwen · legraphista
Params7.62B
Context32K
Smallest1.9 GB
PH
PhysX Omni
Physx · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.8 2B Heretic Max
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
CN
CNY 14B
Cny · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
QW
ReSearch Qwen 7B
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
QV
QVikhr 3 8B Instruction
Qvikhr · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
PE
Pernicious_Prophecy_70B
Pernicious · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
TX
Txgemma 9b Chat
Txgemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
DE
FuseO1 DeepSeekR1 Qwen2.5 Instruct 32B Preview
DeepSeek · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
Qwen2.5 1.5B VibeThinker Heretic Uncensored Abliterated
Qwen · mradermacher
Params1.54B
Context128K
Q4_K_M1.0 GB
ML
MLExpert
Mlexpert · bartowski
Params34.7B
Context256K
Q4_K_M22.3 GB
MI
MiniCPM5 2B
MiniCPM · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
LL
FineMath Llama 3B
Llama · bartowski
Params3.21B
Context4K
Q4_K_M2.0 GB
ZE
zed industries zeta
Zeta · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
CY
TheDrummer Cydonia 24B v2.1
Cydonia · bartowski
Params23.6B
Context32K
Q4_K_M14.3 GB
GE
Gemma 4 E4B It OBLITERATED
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 R1 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 4 E4B it UD japanese imatrix
Gemma · dahara1
Params7.5B
Context128K
Q4_K_M5.0 GB
XL
xLAM 7b R
Xlam · legraphista
Params7.24B
Context32K
Smallest1.6 GB
OL
OLMo 2 1124 7B SFT Preview
OLMo · mradermacher
Params7.3B
Context4K
Q4_K_M4.5 GB
LL
Claude Llama 8B Think
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB