IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
GE
Gemma-4-12B-It
Gemma · unsloth
Params11.9B
Context256K
Q4_K_M7.1 GB
Vision
DE
DeepSeek V4.1 Flash 1017 GSQ RCO
DeepSeek · ISTA-DASLab
Params197B
Context—
Smallest110.6 GB
GGUF
QW
Qwen3.5-9B
Qwen · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.1 GB
Vision
QW
Qwen3.6-35B-A3B
Qwen · unsloth
Params35.5B
Context256K
Q4_K_M22.7 GB
Vision
QW
Qwen3.5-4B
Qwen · unsloth
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
GE
Gemma-4-26B-A4B-It
Gemma · unsloth
Params25.2B
Context256K
Q4_K_M16.9 GB
Vision
QW
Qwen3.5-35B-A3B
Qwen · unsloth
Params34.7B
Context256K
Q4_K_M22.0 GB
Vision
QW
MiMo V2.6 Distill Qwen 9B
Qwen · bartowski
Params8.95B
Context256K
Q4_K_M5.8 GB
CodingTool useVision
QW
Qwen3.6-35B-A3B-Uncensored-HauhauCS-Aggressive
Qwen · HauhauCS
Params34.7B
Context256K
Q4_K_M21.2 GB
Vision
CY
Cyber Ornith 1.5 9B OBLITERATED
Cyber · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
CodingReasoningTool use
OC
Occamy 1.0
Occamy · Accio-Lab
Params34.7B
Context256K
Q4_K_M21.2 GB
Tool useVision
IN
Inkling-Small
Inkling · unsloth
Params264B
Context1024K
Q4_K_M162.5 GB
ReasoningVision
QW
Swift Qwen3.8 27b
Qwen · ukisai
Params27.3B
Context256K
Q4_K_M18.0 GB
ReasoningVision
GE
Gemma-4-E4B-It
Gemma · unsloth
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
QW
Qwen3-4B
Qwen · unsloth
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · unsloth
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
QW
Qwen3-Coder-30B-A3B-Instruct
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
Coding
QW
Qwen3.6 27B Fable Fusion 711 Uncensored Heretic NM DAU NEO MAX MTP
Qwen · DavidAU
Params27B
Context256K
Q4_K_M18.0 GB
CodingReasoningRoleplay
QW
Qwen3-4B-Instruct-2507
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
GGUF
QW
Qwen3.5-2B
Qwen · unsloth
Params1.88B
Context256K
Q4_K_M1.3 GB
Vision
QW
Qwen3-Vl-4B-Instruct
Qwen · unsloth
Params4B
Context256K
Q4_K_M2.5 GB
Vision
LL
Meta Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
OR
Ornith-1.0-9B
Ornith · unsloth
Params8.95B
Context256K
Q4_K_M5.7 GB
Vision
QW
Qwen3-30B-A3B-Instruct-2507
Qwen · unsloth
Params30.5B
Context256K
Q4_K_M18.6 GB
GGUF
BI
BigBang v1
Bigbang · bartowski
Params35.5B
Context256K
Q4_K_M21.9 GB
Vision
QW
Qwen3.6-27B
Qwen · unsloth
Params27B
Context256K
Q4_K_M16.8 GB
Vision
TH
Thomson 1.0 Small
Thomson · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Vision
KA
KAT Coder V2.5 Dev
Kat · bartowski
Params34.7B
Context256K
Q4_K_M21.4 GB
Coding

What is IQ4_NL?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. On average it stores about 4.5 bits per weight, so a IQ4_NL file is roughly 28% of the size of the same model in 16-bit. The usual sweet spot between file size and quality, and the quant most people start with.

32,452 models have a IQ4_NL file on ggufmodels.com, and those files range from 0.0 to 580.0 GB. The most downloaded are Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP, Gemma-4-12B-It and DeepSeek V4.1 Flash 1017 GSQ RCO. For a longer explanation of every quant type, read GGUF quantization explained.

Frequently asked questions

What is IQ4_NL in GGUF?

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. It averages about 4.5 bits per weight.

Should I use IQ4_NL?

The usual sweet spot between file size and quality, and the quant most people start with.

How big is a IQ4_NL file?

IQ4_NL files on this site range from 0.0 to 580.0 GB, depending on the model. As a rule of thumb it is about 28% of the 16-bit size.

Other quants

Keep browsing