IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3-Reranker-0.6B
Qwen · Mungert
Params596M
Context40K
Q4_K_M0.4 GB
Embedding
MI
K2S3 Mistral 7b v1.48
Mistral · RichardErkhov
Params7.37B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen3.5-4B
Qwen · Mazaxaka777
Params4.21B
Context256K
Q4_K_M2.7 GB
Vision
DE
deepseek-coder-6.7B-kexer
DeepSeek · bartowski
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
HO
Hornybot Mara POV
Hornybot · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay
AU
MS3.2 Austral Winton
Austral · bartowski
Params23.6B
Context128K
Q4_K_M14.3 GB
Roleplay
OP
OpenELM-450M
Openelm · RichardErkhov
Params457M
Context2K
Q4_K_M0.3 GB
GGUF
MI
MistralPrism 24B
Mistral · Aratako
Params23.6B
Context128K
Q4_K_M14.3 GB
GGUF
GR
Huihui Granite 4.0 H Tiny Abliterated
Granite · mradermacher
Params6.94B
Context1024K
Q4_K_M4.2 GB
GGUF
BA
Baphomet 1.0 4B
Baphomet · mradermacher
Params4.33B
Context256K
Q4_K_M2.8 GB
Vision
OX
oxy 1 small
Oxy · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Roleplay
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
CH
chronos hermes 13b v2
Chronos · mradermacher
Params13B
Context4K
Q4_K_M8.1 GB
Tool use
OB
MN Oblivion 26B UNCENSORED NEO Imatrix
Oblivion · DavidAU
Params25.6B
Context1000K
Q4_K_M16.3 GB
ReasoningRoleplay
PY
PyThagorean 10B i1
Pythagorean · mradermacher
Params10.3B
Context32K
Q4_K_M6.3 GB
Coding
MI
Ministral 3B Heresy Unfiltered
Mistral · mradermacher
Params3.43B
Context256K
Q4_K_M2.1 GB
GGUF
QW
Qwen3 4B
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
SP
speakleash Bielik 7B Instruct v0.1
Speakleash · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
CA
Cajal 9b v2 Full
Cajal · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
JU
Jugurtha 2 9B
Jugurtha · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
QW
Nu2 Lupi Qwen 14B
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
UR
Urdu Ghazal Generator
Urdu · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Tool use
TR
Transcendental Maid 7B
Transcendental · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
QW
Qwen2.5 3B Instruct
Qwen · legraphista
Params3.09B
Context32K
Smallest0.8 GB
Tool use
SK
Skyfall 31B v4
Skyfall · bartowski
Params31.4B
Context128K
Q4_K_M19.0 GB
GGUF
NE
Nemotron Cascade 14B Thinking
Nemotron · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
Reasoning
QW
Qwen2.5 Omni 7B Abliterated
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
14B Qwen2.5 Freya x1
Qwen · bartowski
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
MA
Magnum v4 9b Abliterated
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Qwen3.5 9B Holodeck Lounge
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
Roleplay

Other quants

Keep browsing