IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
DE
Qwen3.5 9B DeepSeek 3.2 Intense Auto Variable Thinking
DeepSeek · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningRoleplay
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
QW
Qwen3-Vl-235B-A22B-Thinking-1M
Qwen · unsloth
Params235B
Context977K
Q4_K_M142.2 GB
ReasoningVision
LL
Llama 3.1 SuperNova Lite
Llama · legraphista
Params8B
Context128K
Smallest2.0 GB
GGUF
MI
Mistralai Mistral Nemo Instruct 2407 Extensive BP Abliteration 12B
Mistral · mradermacher
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
NO
nomic embed code i1
Nomic · mradermacher
Params7.07B
Context32K
Q4_K_M4.4 GB
CodingEmbeddingTool use
QW
Qwen3-Vl-32B-Thinking-1M
Qwen · unsloth
Params32.8B
Context977K
Q4_K_M19.8 GB
ReasoningVision
PE
PersianMind v1.0
Persianmind · RichardErkhov
Params6.8B
Context2K
Q4_K_M4.1 GB
GGUF
QW
Qwen3.5 9B OBLITERATED
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
GGUF
HO
Holodeck Lounge MTP
Holodeck · mradermacher
Params9.2B
Context256K
Q4_K_M5.8 GB
GGUF
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Smallest8.5 GB
GGUF
GL
GLM-4.7-Flash
GLM · Mungert
Params30B
Context198K
Q4_K_M18.5 GB
GGUF
GR
grimjim kunoichi lemon royale 7B
Grimjim · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
QW
Brie v2 Qwen2.5 3b
Qwen · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
TE
Tessa T1 32B
Tessa · bartowski
Params32.8B
Context117K
Q4_K_M19.9 GB
GGUF
QW
FlashModel Qwen3.5 9B
Qwen · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
WA
Watt Tool 8B GGUF
Watt · eaddario
Params8B
Context128K
Q4_K_M4.4 GB
Tool use
MA
Maestro1 9B
Maestro · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
CodingReasoningTool use
FA
Falcon3 1B Instruct Abliterated
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
OL
Olmo 3 32B Think
OLMo · bartowski
Params32.2B
Context64K
Q4_K_M19.5 GB
Reasoning
RL
RLinf Math 7B
Rlinf · mradermacher
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use
QW
MiMo V2.6 Distill Qwen 9B
Qwen · ldov
Params8.95B
Context256K
Q4_K_M5.8 GB
CodingTool useVision
DA
Dark Pane
Dark · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
QW
Qwen3 8B DAG Reasoning
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
ReasoningTool use
QW
Qwen3.5-4B
Qwen · mistaplanet
Params4.21B
Context256K
Q4_K_M2.7 GB
ReasoningTool useVision
GL
Remnant Glm4 32b
GLM · bartowski
Params32.6B
Context32K
Q4_K_M19.7 GB
Roleplay
IS
Ising Calibration 1.5 31B
Ising · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
AU
Austral 70B Winton
Austral · bartowski
Params70.6B
Context128K
Q4_K_M42.5 GB
Roleplay
LL
Llama Primus Merged
Llama · mradermacher
Params8B
Context128K
Q4_K_M4.9 GB
GGUF
KI
Kimi-K2-Instruct-0905
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
GGUF

Other quants

Keep browsing