IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
MI
Minecraftism 4B Thinking Uncensored
Minecraftism · mradermacher
Params4.02B
Context256K
Q4_K_M2.5 GB
SM
Smart Commit 0.5b v0.3
Smart · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
BR
Bruphin Mika 7B
Bruphin · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
IN
INTELLECT 2
Intellect · bartowski
Params32.8B
Context40K
Q4_K_M19.9 GB
RN
Rnj 1 Instruct
Rnj · bartowski
Params8.3B
Context32K
Q4_K_M5.1 GB
PH
luvGPT phi3 uncensored chat
Phi · bartowski
Params3.82B
Context4K
Q4_K_M2.4 GB
GE
Gemma 4 19B A4B It The DECKARD Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
IN
InternVL3_5 8B
Internvl · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
LL
LLaMA3 iterative DPO final
Llama · bartowski
Params8.03B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 VL Reranker 8B
Qwen · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
PH
AS Pharade 8B
Pharade · mradermacher
Params8B
Context32K
Q4_K_M4.9 GB
XI
XiaoHong v1
Xiaohong · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
VI
Vims2 7B
Vims · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
GE
Gemma 3 270m It Qat
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
QW
X Coder RL Qwen2.5 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
EM
emma 5
Emma · MrMeOrYou
Params614M
Context2K
Q4_K_M0.4 GB
QW
nbeerbower Dumpling Qwen2.5 72B
Qwen · bartowski
Params72.7B
Context128K
Q4_K_M47.4 GB
QW
Qwen3.6 35B A3B REAM 160 ru agent GGUF MTPLess
Qwen · WaveCut
Params22.6B
Context256K
Q4_K_M13.8 GB
QW
Qwen3-Vl-32B-Thinking
Qwen · unsloth
Params32.8B
Context256K
Q4_K_M19.8 GB
NI
B2 Nimble Bophades 9B
Nimble · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
MO
Moonlight 16B A3B Instruct Bruno
Moonlight · mradermacher
Params16B
Context8K
Q4_K_M10.5 GB
VE
Veritas 12B
Veritas · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 12b It Jailbreak ES
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ST
Starling LM 7B beta iMat
Starling · qwp4w3hyb
Params7.24B
Context8K
Q4_K_M4.4 GB
OC
OceanGPT Basic 7B
Oceangpt · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
ST
Starling-LM-7B-alpha-ExPO
Starling · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
SH
Shuttle 3.5
Shuttle · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
KO
Koa AI v2 Code 9B
Koa · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
SU
Sugoi 14B Ultra HF
Sugoi · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
MA
mathstral-7B-v0.1
Mathstral · mmnga
Params7.25B
Context32K
Q4_K_M4.4 GB