IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
LI
Liquid A1B 8B PL Coder
Liquid · mradermacher
Params8.34B
Context125K
Q4_K_M5.0 GB
Coding
QW
Qwen3.8 9B Heretic Uncensored
Qwen · marafx2007
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
GR
Granite 8b Code Instruct 128k
Granite · RichardErkhov
Params8.05B
Context125K
Q4_K_M4.9 GB
Coding
FA
Faithful_Thinking_with_Image
Faithful · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Reasoning
AR
AREX Base
Arex · bartowski
Params122B
Context256K
Q4_K_M74.9 GB
ReasoningTool useVision
JI
jina embeddings v5 omni small retrieval
Jina · jinaai
Params596M
Context32K
Q4_K_M0.4 GB
EmbeddingVision
LL
Llama OpenReviewer 8B
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 E2B It Anon Reasoning
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
QW
Qwen3 4B Abliterated TIES
Qwen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use
QW
Qwen3.5 13B Deckard Heretic Uncensored Thinking
Qwen · mradermacher
Params12.4B
Context256K
Q4_K_M7.7 GB
ReasoningRoleplay
BE
Beam 1.0 501B A23B
Beam · bartowski
Params501B
Context1024K
Q4_K_M314.5 GB
CodingReasoningTool use
MI
mistralai Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
Dobby Unhinged Llama 3.3 70B
Llama · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LE
Lexi Coder v5.1
Lexi · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
Coding
OL
Olmo 3 7B Instruct
OLMo · bartowski
Params7.3B
Context64K
Q4_K_M4.5 GB
GGUF
GR
Granite 4.0 H Tiny
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
WA
Wayfarer 2 12B Absolute Heresy
Wayfarer · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
LL
Llama 3.2 1B Instruct
Llama · ThomasBaruzier
Params1.24B
Context128K
Q4_K_M0.8 GB
Tool use
SM
Smart Commit 1.5b v0.3
Smart · mradermacher
Params1.54B
Context32K
Q4_K_M1.0 GB
Tool use
KL
Klyrune 2B Coder
Klyrune · mradermacher
Params2.52B
Context128K
Q4_K_M1.6 GB
CodingReasoningTool use
MI
Mistral 7B Instruct v0.2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
SI
SIREN 3B
Siren · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
Tool use
RO
Roleplay 9B lora 800 porn i1
Roleplay · mradermacher
Params8.83B
Context16K
Q4_K_M5.3 GB
Roleplay
KI
Kiwen1.1 27B
Kiwen · bartowski
Params27.3B
Context256K
Q4_K_M17.8 GB
ReasoningVision
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
NE
Nemo Gutenberg 12b v1
Nemo · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
MI
Dolphin3.0 Mistral 24B
Mistral · rax4901
Params23.6B
Context32K
Q4_K_M14.3 GB
CodingTool use
QW
Qwen3 Stargate SG1 Uncensored Abliterated 8B
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
CodingReasoning
LL
Llama-3-Lumimaid-8B-v0.1-OAS
Llama · Lewdiculous
Params8B
Context8K
Q4_K_M4.9 GB
Roleplay
ZE
zen 4b i1
Zen · mradermacher
Params4.02B
Context32K
Q4_K_M2.5 GB
ReasoningTool use

Other quants

Keep browsing