IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
QW
Qwen2.5 Coder 7B Instruct Heretic
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
NO
NovaAI
Novaai · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GE
claude 3.7 sonnet reasoning gemma3 12B i1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
DU
DuckDB-NSQL-7B-v0.1
Duckdb · duyntnet
Params6.74B
Context16K
Q4_K_M4.1 GB
LF
LFM2.5 8B A1B Coder
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
JI
jina embeddings v5 omni nano retrieval
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
TR
Triumvirate Qwopus MiMo Ornith 9B Coder
Triumvirate · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
QW
Qwen2.5 VL 3B Instruct Abliterated
Qwen · mradermacher
Params3.09B
Context125K
Q4_K_M1.9 GB
QW
Qwen2.5 Coder 32B
Qwen · xxris
Params32.8B
Context32K
Q4_K_M19.9 GB
GR
granite 3.1 8b Reasoning i1
Granite · mradermacher
Params8.17B
Context128K
Q4_K_M4.9 GB
LL
Meta Llama 3.1 8B Instruct Abliterated
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
DE
DeepHat V1 7B Heretic Abliterated
Deephat · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
HU
Huihui Qwythos 9B Claude Mythos 5 1M Abliterated
Huihui · mradermacher
Params9.2B
Context1024K
Q4_K_M5.8 GB
LL
Turkish Llama 8b v0.1
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
QW
xpo-qwen2
Qwen · RichardErkhov
Params494M
Context32K
Q4_K_M0.4 GB
KE
KernelLLM
Kernelllm · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
NE
TQ2.5 14B Neon v1
Neon · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
TI
Tinyllama 1.1b Abliterated
Tinyllama · mradermacher
Params1.1B
Context2K
Q4_K_M0.7 GB
BE
Beck 8B
Beck · bartowski
Params8.19B
Context40K
Q4_K_M5.0 GB
MI
Minitron 8B Base
Minitron · legraphista
Params8.27B
Context4K
Smallest3.6 GB
GE
Gemma 4 12b Heretic Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
IN
INF AZ 7B 0524
Inf · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
QW
Dumpling Qwen2.5 32B
Qwen · bartowski
Params32.8B
Context128K
Q4_K_M19.9 GB
WI
Wicked Tutu 31B v0.2
Wicked · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
AS
AstraGPTCoder 7B i1
Astragptcoder · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
LL
tifa benchmark llama2 tifa question generation
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
OL
Olmo 3 7B Think DPO
OLMo · mradermacher
Params7.3B
Context64K
Q4_K_M4.5 GB
LL
grimjim Llama 3 Instruct demi merge 8B
Llama · RichardErkhov
Params8B
Context8K
Q4_K_M4.9 GB
YI
Yi-1.5-9B-Chat
Yi · lmstudio-community
Params8.83B
Context4K
Q4_K_M5.3 GB
QW
LFM2 8B A1B Instruct Quantum IQ1C Qwen3.6 35B A3B DISTILL2
Qwen · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB