IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
PH
Phi 3 mini 4k instruct imatrix
Phi · duyntnet
Params3.82B
Context4K
Q4_K_M2.4 GB
CO
Cosmos Reason1 7B Heretic
Cosmos · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
LL
OpenBioLLM Llama3 70B GGUF smashed
Llama · PrunaAI
Params70.6B
Context8K
Q4_K_M42.5 GB
AU
Austral 24B Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
LL
Llama 2 13b Hf
Llama · RichardErkhov
Params13B
Context4K
Q4_K_M7.9 GB
RW
rwkv 6 finch 1b6
Rwkv · latestissue
Params1.6B
Context1024K
Smallest0.7 GB
QW
Qwen3.5 9B Cyberpunk2077 Xiaotian All4 5pass
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
OP
Openhands Lm 7b v0.1
Openhands · bartowski
Params7.62B
Context32K
Q4_K_M4.7 GB
DE
Deepseek Llm 7b Chat Abliterated
DeepSeek · mradermacher
Params6.91B
Context4K
Q4_K_M4.2 GB
IN
Industry Coder 27B v1.0 BF16
Industry · kataguru
Params26.9B
Context256K
Q4_K_M2.0 GB
GE
Gemma 4 12B It Esper4
Gemma · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
FA
Falcon-H1-3B-Instruct
Falcon · unsloth
Params3.15B
Context128K
Q4_K_M1.9 GB
AM
amalia-desenrasca-9b
Amalia · mradermacher
Params9.15B
Context32K
Q4_K_M5.6 GB
LL
Llama3 8b Cpt Sea Lionv2 Instruct
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
QW
Qwen3 VL 2B Thinking
Qwen · bartowski
Params1.72B
Context256K
Q4_K_M1.1 GB
QW
Qwen2.5 VL 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
ME
MedMO 8B Next
Medmo · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
UC
UCLA AGI zephyr 7b sft full SPIN iter3
Ucla · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
QW
Qwen2.5-Vl-7B-Instruct
Qwen · mnsims1024
Params7.62B
Context125K
Q4_K_M4.7 GB
MI
Nexus IKM Mistral Instruct v0.2 7B
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
YO
Youtu-VL-4B-Instruct
Youtu · Mungert
Params4.9B
Context32K
Q4_K_M3.1 GB
ST
StrawberryLemonade L3 70B v1.0
Strawberrylemonade · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
QW
QwQ 32B Preview
Qwen · ThomasBaruzier
Params32.8B
Context32K
Q4_K_M19.9 GB
DE
realtreetune deepseekmath 7b sft GSM8K
DeepSeek · RichardErkhov
Params6.91B
Context4K
Q4_K_M4.2 GB
LL
e n v y Legion V2.1 LLaMa 70B Elarablated v0.8 hf
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
ER
Erebus RP 12B Instruct 2608 v1
Erebus · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GR
Granite 34b Code Base 8k
Granite · RichardErkhov
Params33.7B
Context8K
Q4_K_M21.4 GB
BO
Borealis 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
QW
Qwen3.5 27B RpRMax v1
Qwen · bartowski
Params27B
Context256K
Q4_K_M17.5 GB