IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
DR
DRT O1 14B
Drt · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
RI
RigoChat 7b v2
Rigochat · IIC
Params7.62B
Context32K
Q4_K_M4.7 GB
GU
Gumini 1.5B Base i1
Gumini · GuminiResearch
Params1.54B
Context32K
Q4_K_M1.0 GB
OP
OpenELM-450M-Instruct
Openelm · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
EU
EuroLLM 9B Instruct Heretic
Eurollm · mradermacher
Params9.15B
Context4K
Q4_K_M5.6 GB
QW
Huihui Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
OX
OxytocinErosEngineeringF1 7B slerp
Oxytocinerosengineeringf · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
TU
Turbo Ai 7b
Turbo · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GE
Gemma 4 E2B It GMCE
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
RE
Rei 12B V3 Base
Rei · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
VE
Veloxy 1B
Veloxy · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
NE
ThinkingCap Nemotron 3.5 Lightning 30B A3B abliterated
Nemotron · IstroSec
Params32.9B
Context1024K
Smallest0.1 GB
RA
X Ray_Alpha
Ray · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
PE
PersonaVLM
Personavlm · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Qwen3.5 9B Deckard Claude DIMOE Uncensored Heretic Thinking
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
NE
nvidia OpenCodeReasoning Nemotron 14B
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
LL
Llama 3.2 1B Instruct Abliterated
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
QW
Qwen3.5 9B Claude 3xMerge UNCENSORED Heretic
Qwen · mradermacher
Params8.95B
Context1024K
Q4_K_M5.6 GB
BO
B2 Bophades 9B
Bophades · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
QW
Rombo LLM V3.0 Qwen 32b
Qwen · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
RE
Reka Flash 3
Reka · DavidAU
Params21B
Context32K
Q4_K_M14.3 GB
LL
NPO SAM WMDP llama3 8b instruct i1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
QW
Hemlock Qwen2.5 Coder 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
LI
LimyQstar 7B slerp
Limyqstar · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
LL
Llama 3.1 8B UltraLong 4M Instruct
Llama · bartowski
Params8B
Context4192K
Q4_K_M4.9 GB
MI
Mistral 7B ReMax v0.1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QV
QVikhr 3 8B Instruction
Qvikhr · Vikhrmodels
Params8.19B
Context40K
Q4_K_M5.0 GB