IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
LI
sd3.5 lite
Lite · calcuis
Params2.47B
Context—
Q4_K_M1.8 GB
RN
Rnj-1-Instruct
Rnj · unsloth
Params8.3B
Context32K
Q4_K_M5.1 GB
AU
AutoCoder
Autocoder · legraphista
Params33.3B
Context16K
Smallest7.2 GB
EX
EXAONE Deep 2.4B
Exaone · bartowski
Params2.41B
Context32K
Q4_K_M1.5 GB
LL
Cogito-V2-Preview-Llama-70B
Llama · unsloth
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
Huihui Qwen3.5 9B Abliterated Grimoire SFT
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
DI
DistHermYam 7B ties
Disthermyam · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
KO
Koto Small 7B IT
Koto · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
LY
lynn 7b alpha GGUF smashed
Lynn · PrunaAI
Params7.24B
Context32K
Q4_K_M4.4 GB
MI
Mixtral AI Cyber 2.0
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
RI
Rio 3.5 Open 397B
Rio · bartowski
Params403B
Context256K
Q4_K_M245.0 GB
QW
Qwen3 VL 8B Instruct Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Huihui Qwen3 VL 8B Thinking Abliterated
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
TU
Turkish Llm 7b Instruct
Turkish · mradermacher
Params7.38B
Context32K
Q4_K_M4.5 GB
PA
MS3.2 PaintedFantasy v2 24B
Paintedfantasy · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
QW
Q3.827BTT
Qwen · Kumekaln
Params26.9B
Context256K
Q4_K_M18.0 GB
SK
sketch
Sketch · calcuis
Params11.9B
Context—
Smallest4.0 GB
HU
Humanizer 3B Safetensors
Humanizer · mradermacher
Params3.66B
Context128K
Q4_K_M2.2 GB
LU
LunarAI
Lunarai · mradermacher
Params15.7B
Context160K
Q4_K_M10.4 GB
QW
Ektome Qwen3 VL 8Bi PristinelyUncensored
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 7B Instruct OBLITERATED Advanced
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
MathSmith Hard Problem Synthesizer Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
SK
Skywork OR1 32B
Skywork · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
QW
DreamFast Qwen3 8b Heretic
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
Llama 3.1 Taiwan 8B Instruct
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
KR
Krakowiak 7B v2 i1
Krakowiak · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
OH
Ohashi NeMo 12B
Ohashi · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
RE
RA Reasoner
Reasoner · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
MI
Mistral Large 3 675B Instruct 2512
Mistral · bartowski
Params673B
Context288K
Q4_K_M411.4 GB
OP
OpenClaude 1.7B Merged
Openclaude · bartowski
Params1.72B
Context40K
Q4_K_M1.1 GB