IQ4_NL GGUF models

A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.

Most downloadedNewestLargestLongest contextSmallest
QW
Qwen3.5 2B Claude 4.6 OS Auto Variable HERETIC UNCENSORED THINKING
Qwen · mradermacher
Params1.88B
Context256K
Q4_K_M1.3 GB
ReasoningRoleplay
ST
stabilityai japanese stablelm base gamma 7b
Stabilityai · RichardErkhov
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
LU
dreamgen lucid v1 nemo
Lucid · bartowski
Params12.2B
Context128K
Q4_K_M7.5 GB
GGUF
LL
Llama 2 7b Chat Hf Gpt 4 80k Base_Lora
Llama · RichardErkhov
Params6.74B
Context4K
Q4_K_M4.1 GB
GGUF
QW
Strand-Rust-Coder-14B-v1
Qwen · Mungert
Params14.8B
Context32K
Q4_K_M9.3 GB
Coding
QW
Fathom-Search-4B
Qwen · Mungert
Params4B
Context40K
Q4_K_M2.6 GB
GGUF
MI
Ministral 3 14B Reasoning 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
Reasoning
QW
Qwen3 8B Abliterated
Qwen · mradermacher
Params8.19B
Context40K
Q4_K_M5.0 GB
GGUF
SP
Spark X2.6 4B Uncensored
Spark · mradermacher
Params4.11B
Context1024K
Q4_K_M2.6 GB
ReasoningTool use
IR
Iris 12B v1.4.1
Iris · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GR
Granite 3b Code Base
Granite · RichardErkhov
Params3.48B
Context2K
Q4_K_M2.1 GB
Coding
NE
neo_7b_instruct_v0.1
Neo · legraphista
Params7.79B
Context8K
Smallest1.7 GB
GGUF
QW
Qwen3 0.6B Heretic Abliterated Uncensored
Qwen · Andycurrent
Params596M
Context40K
Q4_K_M0.4 GB
GGUF
QW
Qwen1.5-MoE-A2.7B-Chat
Qwen · RichardErkhov
Params14.3B
Context32K
Q4_K_M9.5 GB
GGUF
GE
gemma 3 12b it ultra uncensored heretic
Gemma · llmfan46
Params11.8B
Context128K
Smallest4.8 GB
Vision
AD
AdaGuard 8B
Adaguard · mradermacher
Params8.19B
Context32K
Q4_K_M5.0 GB
GGUF
FA
Falcon3 1B Instruct
Falcon · bartowski
Params1.67B
Context8K
Q4_K_M1.1 GB
GGUF
QW
Qwen3.6 35B A3B REAM 160 ru agent
Qwen · WaveCut
Params23.1B
Context256K
Q4_K_M14.4 GB
GGUF
AY
aya-23-8B
Aya · legraphista
Params8B
Context8K
Smallest2.2 GB
GGUF
DE
DeepCoder 14B Preview
Deepcoder · bartowski
Params14.8B
Context128K
Q4_K_M9.0 GB
Coding
AR
ArrowPro-7B-KillerWhale
Arrowpro · mmnga
Params7.24B
Context4K
Q4_K_M4.4 GB
GGUF
GR
Granite 3.2 8b Instruct
Granite · bartowski
Params8.17B
Context128K
Q4_K_M4.9 GB
GGUF
BE
berkeley nest Starling LM 7B alpha
Berkeley · RichardErkhov
Params7.24B
Context8K
Q4_K_M4.4 GB
GGUF
DA
Darwin 4B Chimera
Darwin · bartowski
Params4B
Context40K
Q4_K_M2.6 GB
Reasoning
MI
Ministral 3 14B Instruct 2512 Absolute Heresy
Mistral · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
GGUF
MO
MoNeuTrix MoE 4x7B i1
Moneutrix · mradermacher
Params24.2B
Context32K
Q4_K_M14.8 GB
GGUF
LL
Llama 3.2 1B Instruct
Llama · legraphista
Params1.24B
Context128K
Smallest0.4 GB
GGUF
DW
Dwight 4b
Dwight · bartowski
Params4B
Context256K
Q4_K_M2.6 GB
GGUF
QW
Qwen2.5-3B-Instruct
Qwen · Mungert
Params3.1B
Context32K
Q4_K_M1.9 GB
GGUF
LL
Llama Leonida v2
Llama · mradermacher
Params8.2B
Context128K
Q4_K_M5.0 GB
GGUF

Other quants

Keep browsing