IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
AD
MN Adversary 12B v1
Adversary · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
Roleplay
QW
Qwable 9B Claude Fable 5
Qwable · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
PH
Phi 4 Heretic
Phi · mradermacher
Params14.7B
Context16K
Q4_K_M9.1 GB
Coding
QW
Qwen3 Hermes8B v1
Qwen · mradermacher
Params8.2B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
GR
GreatRag 13B slerp
Greatrag · mradermacher
Params6.74B
Context2K
Q4_K_M4.2 GB
GGUF
GR
Granite Embedding 278m Multilingual
Granite · bartowski
Params278M
Context512
Q4_K_M0.2 GB
Embedding
OL
open r1 OlympicCoder 32B
Olympiccoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
CodingReasoning
OP
Openchat_3.5
Openchat · mradermacher
Params7.24B
Context8K
Q4_K_M4.4 GB
Coding
CY
Cydonia ReduX 22B v1
Cydonia · bartowski
Params22.2B
Context32K
Q4_K_M13.3 GB
GGUF
NE
Heretic Nemotron Content Safety Reasoning 4B
Nemotron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
QW
Qwen3.5 9B The Defiant Fable Uncensored Heretic NEO IMATRIX MAX MTP
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
CodingReasoningRoleplay
GE
FuseChat Gemma 2 9B Instruct
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ST
STELLA VLM JoVE 7B
Stella · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
GE
Gemma 4 12B Agentic Fable5 Composer2.5 v2 3.5x Tau2 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
OL
Olmo-3.1-32B-Think
OLMo · unsloth
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
LL
nvidia Llama3 ChatQA 1.5 8B GGUF smashed
Llama · PrunaAI
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
NE
NextCoder 32B
Nextcoder · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
Coding
QU
QuasiStarSynth 12B Absolute Heresy
Quasistarsynth · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
GGUF
TE
Tessa T1 3B
Tessa · bartowski
Params3.09B
Context117K
Q4_K_M1.9 GB
GGUF
GR
Granite 4.0 H Micro
Granite · bartowski
Params3.2B
Context1024K
Q4_K_M1.9 GB
GGUF
MI
Mistral-Small-3.2-24B-Instruct-2506
Mistral · Sci-fi-vy
Params23.6B
Context128K
Q4_K_M14.3 GB
Vision
LL
LLaMAntino 2 7b Hf ITA
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
KO
KoSOLAR 10.9B v1.0
Kosolar · mradermacher
Params10.9B
Context4K
Q4_K_M7.2 GB
GGUF
GE
Gemma 3 12b It Vl GLM 4.7 Flash INSTRUCT Thinking Hybrid Heretic Uncensored
Gemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
ReasoningVision
SK
Skywork OR1 7B
Skywork · bartowski
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
CO
CogniDet
Cognidet · mradermacher
Params8.03B
Context128K
Q4_K_M4.9 GB
Tool use
MI
jisukim8873 mistral 7B alpaca case 1 2
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
RA
Ramakrishna 7b v4
Ramakrishna · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
DE
WR30a Deep 7B 0711
Deep · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
MI
Mistral 7B Instruct v0.2
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF

Other quants

Keep browsing