IQ4_NL GGUF models
A GGUF quantization format. Lower numbers mean smaller files and more quality loss. 32452 models have a IQ4_NL file. Sizes run from 1M to 1030B parameters. The longest trained context is 102400K tokens.
QW
Qwen3.8-27B
Qwen · qtum
Params27B
Context256K
Q4_K_M17.7 GB
MU
Muse Glimmer 30B Esper4
Muse · bartowski
Params27.9B
Context128K
Q4_K_M17.3 GB
DE
uncensoredai UncensoredLM DeepSeek R1 Distill Qwen 14B
DeepSeek · bartowski
Params14.2B
Context128K
Q4_K_M8.6 GB
AM
Amaretto 14B
Amaretto · mradermacher
Params13.5B
Context256K
Q4_K_M8.2 GB
QW
Qwen3.5 4B Claude 3xMerge Jackrong UNCENSORED Heretic
Qwen · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
CY
Cyber Tiel Coder 35B A3B MTP TTQ
Cyber · TokenTinkerer
Params35.5B
Context256K
Q4_K_M21.6 GB
MI
Voxtral Mini 3B 2507
Mistral · bartowski
Params4.01B
Context128K
Q4_K_M2.5 GB
AE
AesCode 8B
Aescode · mradermacher
Params8.19B
Context256K
Q4_K_M5.0 GB
JI
Jina Embeddings v5 Text Nano Text Matching
Jina · jinaai
Params212M
Context8K
Q4_K_M0.2 GB
OR
Ornith 1.0 9B
Ornith · bartowski
Params8.95B
Context256K
Q4_K_M5.9 GB
GR
Granite-4.0-H-Small
Granite · unsloth
Params32.2B
Context1024K
Q4_K_M19.6 GB
GE
Gemma 4 31B It Scotoma 2
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
TE
tensor bank
Tensor · gguf-org
Params—
Context—
Q4_K_M0.0 GB
MI
Ministral 3 8B Instruct 2512
Mistral · bartowski
Params8.49B
Context256K
Q4_K_M5.2 GB
AV
Avrik Pro 12B
Avrik · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
SA
Sarashina2.2 3b Instruct v0.1
Sarashina · mmnga
Params3.36B
Context8K
Q4_K_M2.1 GB
KI
Kimi-K2-Thinking
Kimi · unsloth
Params1030B
Context256K
Q4_K_M621.2 GB
MA
manaca 1b base
Manaca · NANI-Nithin
Params1.72B
Context4K
Q4_K_M1.1 GB
LO
LongWriter Zero 32B
Longwriter · bartowski
Params32.8B
Context32K
Q4_K_M19.9 GB
LL
Llama-3_3-Nemotron-Super-49B-V1_5
Llama · unsloth
Params49.9B
Context128K
Q4_K_M30.2 GB
QW
Qwen3-30B-A3B-128K
Qwen · unsloth
Params30.5B
Context128K
Q4_K_M18.6 GB
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
MI
Minimax-M2.5
Minimax · unsloth
Params230B
Context192K
Q4_K_M138.3 GB
SU
Sulphur 2 Prompt Enhancer Uncensored
Sulphur · PeppX
Params8.95B
Context256K
Q4_K_M5.6 GB
SH
Shadow-Siren-14B-v2-Pruned
Shadow · mradermacher
Params13.8B
Context256K
Q4_K_M9.2 GB
IN
InternVL3_5 38B
Internvl · bartowski
Params32.8B
Context40K
Q4_K_M19.8 GB
DE
Deepseeker Kunou Qwen2.5 14b i1
DeepSeek · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ZW
ZwZ2 4B
Zwz · mradermacher
Params4.21B
Context256K
Q4_K_M2.7 GB
LL
Meta-Llama-3-8B-Instruct-abliterated-v3
Llama · legraphista
Params8B
Context8K
Smallest2.0 GB
MI
Mistral Small 4 119B 2603 Heretic
Mistral · Rioky
Params119B
Context1024K
Q4_K_M72.2 GB