IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwythos 9B v2
Qwythos · mradermacher
Params9.2B
Context1024K
Q4_K_M5.8 GB
Reasoning
NE
NeoHorse 1 9 Uncensored
Neohorse · mradermacher
Params8.95B
Context256K
Q4_K_M5.6 GB
ReasoningTool use
DA
Dark Scarlett 27B v3.0
Dark · ReadyArt
Params27.3B
Context256K
Q4_K_M23.5 GB
Roleplay
KA
KansenSakura Eclipse RP 12b
Kansensakura · mradermacher
Params12.2B
Context1000K
Q4_K_M7.5 GB
Roleplay
GE
gemma 4 E2B it UD japanese imatrix
Gemma · dahara1
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
MI
MiniCPM V 4.7 1B Heretic
MiniCPM · mradermacher
Params1.01B
Context256K
Q4_K_M0.7 GB
RoleplayVision
QW
Qwen3-Vl-8B-Thinking-1M
Qwen · unsloth
Params8.19B
Context977K
Q4_K_M5.0 GB
ReasoningVision
GR
Granite 8b Code Instruct 4k
Granite · RichardErkhov
Params8.05B
Context4K
Q4_K_M4.9 GB
Coding
QW
WhereOPD Qwen3.5 4B
Qwen · mradermacher
Params4.84B
Context256K
Q4_K_M3.1 GB
GGUF
LL
Meta Llama 3 8B Instruct GGUF Imatrix smashed
Llama · PrunaAI
Params8B
Context8K
Q4_K_M4.9 GB
GGUF
BO
Borealis Open 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
LF
LFM2.5 8B A1B Hermes Agentic Coder Abliterated v3
Lfm · mradermacher
Params8.47B
Context125K
Q4_K_M5.2 GB
CodingReasoningTool use
LU
Lumimaid Magnum v4 12B
Lumimaid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
QW
DPO Trained Qwen2.5 Python Coder 7B
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
Coding
QW
Qwen3.5 2B Uncensored Zero Refusal SOMA
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
RoleplayVision
MI
Tamil-Mistral-7B-v0.1
Mistral · RichardErkhov
Params7.39B
Context32K
Q4_K_M4.5 GB
GGUF
OR
Ornith 1.0 397B
Ornith · unsloth
Params397B
Context256K
Q4_K_M245.0 GB
GGUF
NE
Nemotron 3.5 Embed 8B BF16
Nemotron · W4D
Params7.95B
Context256K
Q4_K_M4.9 GB
EmbeddingVision
QW
Qwen3 14B NSFW FDA
Qwen · mradermacher
Params14.8B
Context32K
Q4_K_M9.0 GB
GGUF
LF
LFM2 24B A2B
Lfm · bartowski
Params23.8B
Context125K
Q4_K_M14.4 GB
GGUF
PH
Unsloth Phi 3.5 Mini Instruct
Phi · legraphista
Params3.82B
Context128K
Smallest0.9 GB
GGUF
QW
FlashModel Qwen 3.6 35B A3B Maxed
Qwen · flashback2k
Params35.5B
Context256K
Q4_K_M21.7 GB
ReasoningTool useVision
AP
Apertus-70B-Instruct-2509
Apertus · unsloth
Params70.6B
Context64K
Q4_K_M43.7 GB
GGUF
SP
SpydazWeb_AI_LCARS_Humanization_003
Spydazweb · mradermacher
Params7.24B
Context512K
Q4_K_M4.4 GB
Coding
QW
Qwen2.5 72B Instruct
Qwen · mradermacher
Params72.7B
Context32K
Q4_K_M47.4 GB
GGUF
CO
CogEvol 4B
Cogevol · bartowski
Params4.21B
Context256K
Q4_K_M2.9 GB
Vision
QW
Qwen2.5 7b Alpaca
Qwen · mradermacher
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
QW
ThinCtx Qwen3.5 0.8B
Qwen · mradermacher
Params752M
Context256K
Q4_K_M0.5 GB
GGUF
SE
Seed-Coder-8B-Instruct
Seed · unsloth
Params8.25B
Context32K
Q4_K_M5.1 GB
Coding
QW
Qwen2.5 1.5B Instruct
Qwen · ThomasBaruzier
Params1.54B
Context32K
Q4_K_M1.0 GB
GGUF

Other quants

Keep browsing