IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
CH
Chandra
Chandra · noctrex
Params8.19B
Context256K
Q4_K_M5.0 GB
QW
Qwen3 ST The Next Generation II E32 v1 256k Ctx 6B
Qwen · mradermacher
Params6.33B
Context256K
Q4_K_M3.9 GB
OR
Ornith 1.5 9B OBLITERATED
Ornith · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ST
Step 3.5 Flash
Step · bartowski
Params197B
Context256K
Q4_K_M119.9 GB
QW
Qwen3.5 4B Element
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
GR
granite-7b-base
Granite · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
SH
Shieldgemma 27b
Shieldgemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
TA
UI TARS 72B SFT
Tars · bartowski
Params72.7B
Context32K
Q4_K_M47.4 GB
DE
Deepthink Reasoning 7B imatrix
Deepthink · duyntnet
Params7.62B
Context32K
Q4_K_M4.7 GB
QW
Qwen2.5 7B OBLITERATED
Qwen · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
DA
L3 Dark Planet 8B HERETIC Uncensored Abliterated
Dark · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwopus3.5 9B v3.5
Qwopus · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GE
EZO Common T2 2B Gemma 2 It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
HE
Hembot 7B v1
Hembot · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
TR
Trinity Large Preview
Trinity · bartowski
Params399B
Context256K
Q4_K_M241.6 GB
OM
OmniCoder 2 9B
Omnicoder · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ME
Mellum2.1 12B A2.5B Thinking Abliterated
Mellum · mradermacher
Params12.1B
Context128K
Q4_K_M8.1 GB
LL
Llama3 8b It Translation Sharegpt En Ko
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
GR
Granite 4.1 30b
Granite · bartowski
Params28.9B
Context128K
Q4_K_M17.8 GB
DA
datagemma rag 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
LF
LFM2.5 Encoder 230M
Lfm · mradermacher
Params230M
Context125K
Q4_K_M0.2 GB
MA
Magistry 24B v1.1
Magistry · bartowski
Params23.6B
Context128K
Q4_K_M14.6 GB
MI
MiroThinker v1.0 8B
Mirothinker · bartowski
Params8.19B
Context256K
Q4_K_M5.0 GB
AT
ATLAS Teach 8B Instruct
Atlas · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen2.5 Coder 7B Instruct
Qwen · ThomasBaruzier
Params7.62B
Context32K
Q4_K_M4.7 GB
MI
grimjim Mistral Starling merge trial3 7B
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
DR
DREX 062225 Exp
Drex · mradermacher
Params7.6B
Context125K
Q4_K_M4.7 GB
OL
Olmo-3-7B-Think
OLMo · Mungert
Params7.3B
Context64K
Q4_K_M4.7 GB
MO
Mordant 7B Think
Mordant · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
NE
Nebula 8lang 7b
Nebula · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB