IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
OM
Omni R1
Omni · mradermacher
Params7B
Context5K
Q4_K_M4.3 GB
MI
K2S3 Mistral 7b v1.46
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GE
Gemma 4 E4B It The DECKARD Claude Opus Expresso Universe HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
QW
Qwen2.5 Coder 1.5B Unsensored DPO
Qwen · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
QW
Qwen3 4B Instruct 2507 Abliterated
Qwen · mradermacher
Params4B
Context256K
Q4_K_M2.5 GB
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
MI
Mizan v3 3B
Mizan · bartowski
Params2.9B
Context256K
Q4_K_M2.0 GB
QW
Josiefied Qwen3 8B Abliterated v1
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
Qwen3 72B Embiggened
Qwen · bartowski
Params72.7B
Context40K
Q4_K_M47.4 GB
QW
QwQ LCoT2 7B Instruct i1
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GR
granite 4.2 3b
Granite · NANI-Nithin
Params3.66B
Context128K
Q4_K_M2.2 GB
QW
Qwen2.5 0.5B
Qwen · mradermacher
Params494M
Context32K
Q4_K_M0.4 GB
EU
Eurus 2 7B PRIME
Eurus · bartowski
Params7.62B
Context4K
Q4_K_M4.7 GB
MI
Mistral-7B-v0.3
Mistral · legraphista
Params7.25B
Context32K
Smallest1.6 GB
QW
Qwen3.5 9B Claude 4.6 HighIQ INSTRUCT HERETIC UNCENSORED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
KU
Kunoichi DPO v2 7B
Kunoichi · brittlewis12
Params7.24B
Context8K
Q4_K_M4.4 GB
DE
Josiefied DeepSeek R1 0528 Qwen3 8B Abliterated v1
DeepSeek · mradermacher
Params8.19B
Context128K
Q4_K_M5.0 GB
RU
MN 12B Runeweaver RP RU
Runeweaver · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
TR
Trinity Mini
Trinity · bartowski
Params26B
Context128K
Q4_K_M15.9 GB
DE
DeepSeek R1 Distill Qwen 14B Abliterated
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
LL
ToolACE 2.5 Llama 3.1 8B Heretic
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GE
Gemma 2 2b
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
PI
Piaget 8B
Piaget · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
QW
GrayLine Qwen3 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GL
zai org GLM 4.5
GLM · bartowski
Params358B
Context128K
Q4_K_M218.5 GB
DR
DrakIdol Roleplayer 1.0
Drakidol · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
Magistral Small 2507
Mistral · bartowski
Params23.6B
Context40K
Q4_K_M14.3 GB
QW
jinaai/test-qwen25-coder-jina-code-embeddings-1.5b
Qwen · jinaai
Params1.54B
Context32K
Smallest0.4 GB
QW
Qwen3.5 9B Star Trek TNG DS9 Heretic Uncensored Thinking MAX NEOCODE
Qwen · DavidAU
Params8.95B
Context256K
Q4_K_M6.8 GB
GE
Amoral Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB