IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · diablomike20
Params8.95B
Context256K
Q4_K_M6.8 GB
CodingReasoningRoleplay
QW
Qwen3.5 9B DS9 USS Defiant
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
QW
Qwen3 Esper3 Reasoning Instruct 6B Brainstorm20x Enhanced E32 128k Ctx
Qwen · mradermacher
Params5.94B
Context128K
Q4_K_M3.6 GB
CodingReasoning
VI
vicgalle Configurable Janus 7B
Vicgalle · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LA
Laguna S 2.1
Laguna · bartowski
Params118B
Context1024K
Q4_K_M71.8 GB
GGUF
MI
Dolphin3.0 R1 Mistral 24B
Mistral · eaddario
Params23.6B
Context32K
Q4_K_M13.1 GB
Reasoning
LL
Meta-Llama-3-8B-Instruct
Llama · bartowski
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
QW
Qwen2.5 14B Instruct Abliterated v2
Qwen · RichardErkhov
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
VI
Virtuoso Lite
Virtuoso · bartowski
Params10.3B
Context32K
Q4_K_M6.3 GB
GGUF
MI
failspy Codestral 22B v0.1 abliterated v3
Mistral · RichardErkhov
Params22.2B
Context32K
Q4_K_M13.3 GB
Coding
GR
granite-4.0-h-350m
Granite · Mungert
Params340M
Context1024K
Q4_K_M0.2 GB
GGUF
MI
NSFW DPO Noromaid 7b Mistral 7B Instruct v0.1
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
Roleplay
LL
ADG CoT LLaMa3 8B
Llama · mradermacher
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
MU
G4 E4B Musica v1
Musica · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
ReasoningRoleplayVision
NI
Nightshade-Violet-12B
Nightshade · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
MI
AmeerH Mistral Math 2x7b mix
Mistral · RichardErkhov
Params12.9B
Context32K
Q4_K_M7.8 GB
GGUF
LL
Meta Llama Llama 3.2 3B Instruct Heretic Nosyco
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
Tool use
GE
Gemma 2 27b It Abliterated
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
VI
Vicuna 7b v1.3
Vicuna · RichardErkhov
Params6.74B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Qwen3 14B Gemini 3 Pro Preview High Reasoning Distill
Qwen · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
Reasoning
MI
MiniCPM O 2_6
MiniCPM · bartowski
Params7.6B
Context32K
Q4_K_M4.7 GB
CodingVision
LL
FuseChat Llama 3.1 8B Instruct
Llama · bartowski
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
SN
Snowpiercer 15B v3
Snowpiercer · bartowski
Params15B
Context64K
Q4_K_M9.1 GB
GGUF
AN
Andy 4.2
Andy · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DO
Dolphin v2 8b Abliterated
Dolphin · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
SE
Selene 3B Instruct
Selene · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
LL
Dolphin 3.0 Llama 3.2 3B
Llama · mradermacher
Params3.21B
Context128K
Q4_K_M2.0 GB
CodingTool use
RE
Reggie v3 7b
Reggie · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
ReasoningVision
HU
Huihui Qwopus3.5 9B v3 Abliterated
Huihui · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Reasoning
DR
DrakIdol Roleplayer 1.0
Drakidol · Emerald7664
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay

Other quants

Keep browsing