IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
HU
Hunyuan A13B Instruct
Hunyuan · bartowski
Params80.4B
Context256K
Q4_K_M49.3 GB
GGUF
LL
Llama 3.1 8B Instruct Abliterated Obliteratus
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
XW
XwinCoder 7B i1
Xwincoder · mradermacher
Params6.74B
Context16K
Q4_K_M4.1 GB
Coding
ME
MenteE Code 3B
Mentee · mradermacher
Params3.09B
Context128K
Q4_K_M1.9 GB
CodingTool use
QW
Qwen3.5 9B Cyberpunk2077 Xiaotian Qin V2 V3 5pass
Qwen · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
ReasoningTool use
RE
reader lm 0.5b IMat
Reader · legraphista
Params494M
Context250K
Smallest0.3 GB
GGUF
MI
OpenMath-Mistral-7B-v0.1-hf
Mistral · duyntnet
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
ST
STARK WEB 12B v1.7
Stark · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
ZW
ZwZ 7B i1
Zwz · mradermacher
Params7.62B
Context125K
Q4_K_M4.7 GB
GGUF
RO
RoboBrain2.0 7B
Robobrain · bartowski
Params7.62B
Context125K
Q4_K_M4.7 GB
Vision
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
LF
Koda IDS Frontier F16
Lfm · netgoat-ai
Params2.7B
Context128K
Q4_K_M1.7 GB
Reasoning
QW
Qwen3 4B Uncensored
Qwen · mradermacher
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
LL
Llama Guard 3 1B
Llama · RichardErkhov
Params1.5B
Context128K
Q4_K_M1.0 GB
GGUF
LL
HexaMind Llama 3.1 8B v25 Generalist
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
Reasoning
MI
juhwanlee llmdo Mistral 7B case 1
Mistral · RichardErkhov
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
LL
llava llama 3 8b v1 1 GGUF smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
Vision
QW
Qwen3-32B
Qwen · openwalrus
Params32.8B
Context40K
Q4_K_M19.8 GB
GGUF
NI
Ninja v1 NSFW
Ninja · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
DE
Qwen3 14B DeepSeek v3.2 Speciale Distill
DeepSeek · TeichAI
Params14.8B
Context40K
Q4_K_M9.0 GB
CodingReasoning
MI
Mistral v2 orpo
Mistral · mradermacher
Params7.24B
Context32K
Q4_K_M4.5 GB
GGUF
BE
Beck 4B
Beck · bartowski
Params4B
Context40K
Q4_K_M2.5 GB
GGUF
QW
Qwen3-Vl-4B-Instruct-1M
Qwen · unsloth
Params4B
Context977K
Q4_K_M2.5 GB
Vision
FN
FNova 1.7B Chat v1
Fnova · mradermacher
Params1.72B
Context32K
Q4_K_M1.1 GB
ReasoningTool use
CH
CHIMERA 4B RL
Chimera · mradermacher
Params4.41B
Context256K
Q4_K_M2.7 GB
Reasoning
GE
GEITje 7B
Geitje · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
GE
Gemma 3 12b It Vl GPT 5.1 High Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
OR
Ornith 1.5 9B
Ornith · NANI-Nithin
Params9.2B
Context256K
Q4_K_M5.8 GB
Vision
QW
Qwen2.5 VL 7B Instruct
Qwen · ariel-pillar
Params7.62B
Context32K
Q4_K_M4.7 GB
Vision

Other quants

Keep browsing