Nex N2 Pro MTP needs about 159.9 GB of memory at its main file (a 142.3 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 6 quants, from 13.2 GB to 256.0 GB (IQ4_NL).
Agentic LLM with 403B parameters for complex task execution
Nex N2 Pro MTP is a 403B‑parameter model built on Qwen3.5‑397B‑A17B. It supports agentic thinking, coding, and tool use. The model is released under Apache‑2.0 and is available in several GGUF quantizations.
Good at
- Agentic coding
- Long‑horizon task planning
- Tool‑based execution
Limits
- No vision support
- Requires large VRAM for full precision
- Limited to 8k context
Best for
- Automated coding workflows
- Research task automation
- Terminal‑based agentic tasks
Who it’s for. Developers and researchers needing an open‑source agentic model for complex, multi‑step tasks. The model is suitable for those who can allocate sufficient GPU memory and prefer a model with a clear agentic framework.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 13.2 GB | 15.3 GB | Too big | Get file → | |
| — | 103.9 GB (23 parts) | 116.9 GB | Too big | Get file → | |
| — | 142.3 GB (23 parts) | 159.9 GB | Too big | Get file → | |
| IQ3_XS | 191.8 GB (23 parts) | 215.3 GB | Too big | Get file → | |
| IQ3_M | 204.6 GB (23 parts) | 229.7 GB | Too big | Get file → | |
| IQ4_NL | 256.0 GB (23 parts) | 287.2 GB | Too big | Get file → |
For 8‑GB VRAM, use IQ3_XS (191.79 GB file, ~215.3 GB memory at 8k). For 16‑GB VRAM, IQ4_NL (256.01 GB file, ~287.2 GB memory). For larger GPUs, the full‑precision file (13.19 GB) can be used, but memory usage is ~15.3 GB at 8k context.
What GPU do you need for Nex N2 Pro MTP?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: the best quant that fits is the main file (13.2 GB file, about 15.3 GB in use).
- 24 GB VRAM: the best quant that fits is the main file (13.2 GB file, about 15.3 GB in use).
- 32 GB VRAM: the best quant that fits is the main file (13.2 GB file, about 15.3 GB in use).
- 48 GB VRAM: the best quant that fits is the main file (13.2 GB file, about 15.3 GB in use).
Which Nex N2 Pro MTP quant should you choose?
If memory is tight, the smallest file is the first one in the table at 13.2 GB, with the quality trade-offs that come with fewer bits.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Nex N2 Pro MTP
How much VRAM does Nex N2 Pro MTP need?
About 159.9 GB at its main file with an 8K context window. That is the 142.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Nex N2 Pro MTP on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 15.3 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Nex N2 Pro MTP GGUF?
It depends on the quant: file is 13.2 GB, file is 103.9 GB, file is 142.3 GB, IQ3_XS is 191.8 GB, IQ3_M is 204.6 GB, IQ4_NL is 256.0 GB.
Where can I download Nex N2 Pro MTP GGUF?
The files are on Hugging Face in the morikomorizz/Nex-N2-Pro-MTP-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Nex N2 Pro MTP use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Nex N2 Pro MTP on 8 GB VRAM?
Only the IQ3_XS quantization can be loaded on 8 GB VRAM, but it still requires ~215.3 GB memory at 8k context, so it is not feasible on 8 GB VRAM.
Does the model support vision?
No, the model does not support vision capabilities.
What license applies to this model?
The model is released under the Apache‑2.0 license.