IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
MI
Mira 12b
Mira · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
QW
Qwen2.5 Coder 1.5B Instruct
Qwen · legraphista
Params1.54B
Context32K
Smallest0.4 GB
JP
jpacifico Chocolatine 14B Instruct 4k DPO
Jpacifico · RichardErkhov
Params14B
Context4K
Q4_K_M8.6 GB
QW
Qwen2.5 72B Instruct
Qwen · legraphista
Params72.7B
Context32K
Smallest23.7 GB
B4
B4 9B i1
mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
NE
nvidia OpenCodeReasoning Nemotron 32B IOI
Nemotron · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
QW
Huihui Qwen3.5 9B Abliterated Grimoire SimPO
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
SA
Salamandra 7b Instruct Uncensored Abliterated
Salamandra · mradermacher
Params7.77B
Context8K
Q4_K_M4.9 GB
AF
AfriqueQwen3.5 9B 50Langs
Afriqueqwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
Gemma 4 12B It Tachibana Agent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ST
L3-8B-Stheno-v3.2
Stheno · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 Coder 480B A35B Instruct
Qwen · bartowski
Params480B
Context256K
Q4_K_M290.8 GB
NA
Nanbeige1.5 8B Chat
Nanbeige · mradermacher
Params7.77B
Context4K
Q4_K_M5.0 GB
OP
OpenElla NovelWriter 8B V2 Merged
Openella · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
BI
Bielik Minitron 7B v3.0 Instruct Heretic
Bielik · mradermacher
Params7.48B
Context32K
Q4_K_M4.5 GB
QW
Qwen2.5 VL 3B Instruct Unredacted MAX
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
MI
MiniCPM5 1B
MiniCPM · mradermacher
Params1.08B
Context128K
Q4_K_M0.7 GB
SA
Sarashina2.2 0.5b Instruct v0.1
Sarashina · mmnga
Params793M
Context8K
Q4_K_M0.5 GB
PO
Polaris 7B Preview
Polaris · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
RY
RynnBrain CoP 8B
Rynnbrain · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
LL
haqishen Llama 3 8B Japanese Instruct
Llama · mmnga
Params8B
Context8K
Q4_K_M4.9 GB
TI
Tifa DeepsexV2 7b MGRPO Safetensors
Tifa · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen3.5-4B
Qwen · Heppygaga
Params4.21B
Context256K
Q4_K_M2.7 GB
QW
Huihui Qwen3.5 4B Claude 4.6 Opus Abliterated
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LI
Ling Lite 0415
Ling · bartowski
Params16.8B
Context32K
Q4_K_M11.2 GB
NE
addis scribe streaming
Nemotron · addisai
Params99M
Context—
Smallest0.0 GB
BA
L2 7b Base Guanaco Uncensored i1
Base · mradermacher
Params6.74B
Context4K
Q4_K_M4.1 GB
LL
Llama 3.1 Minitron 4B Width Base
Llama · legraphista
Params4.51B
Context128K
Smallest1.8 GB
ZE
zephyr-7b-sft-full-SPIN-iter3
Zephyr · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
HE
Hearthfire 24B
Hearthfire · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB