QW

Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local)

QwenGGUF by fairfieldtUpdated 2026-10-16
Download on Hugging Face
Parameters157B
Context256K
Layers49
Architectureqwen4exp
Smallest quant105.6 GB
Quick answer

Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local) needs about 106.9 GB of memory at its main file (a 105.6 GB file) with an 8K context window, which is more than a 48 GB GPU holds. Longer context needs more: at 32K tokens the KV cache alone adds about 3.3 GB.

Qwen3.8-Flash-Next NVFP4 QAD – 157B parameter auto‑regressive language model

The Qwen3.8-Flash-Next NVFP4 QAD model is a 157B parameter transformer with Mixture‑of‑Experts and hybrid attention. It is quantized with QAD and stored in a single GGUF file of 105.57 GB. The model supports a 262144‑token context window.

Good at

  • Large context generation
  • Mixture‑of‑Experts inference
  • Hybrid attention efficiency

Limits

  • Requires >106 GB VRAM for 8 k context
  • No vision support in this GGUF
  • License governed by NVIDIA Open Model Agreement

Best for

  • AI agent systems
  • Chatbots
  • RAG applications

Who it’s for. Developers needing a pre‑quantized, large‑context language model for deployment on local AI hardware. The model is suitable for commercial or non‑commercial use under NVIDIA Open Model Agreement.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—105.6 GB 106.9 GB
Too big Get file →

The only available GGUF file is unquantized and requires about 106.9 GB of VRAM at 8 k context. For systems with less VRAM, a different quantization is needed, but none is provided here. Use the file only if your GPU can accommodate the memory estimate.

What GPU do you need for Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local)?

These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: no quant fits at an 8K context.
  • 8 GB VRAM: no quant fits at an 8K context.
  • 12 GB VRAM: no quant fits at an 8K context.
  • 16 GB VRAM: no quant fits at an 8K context.
  • 24 GB VRAM: no quant fits at an 8K context.
  • 32 GB VRAM: no quant fits at an 8K context.
  • 48 GB VRAM: no quant fits at an 8K context.

Specifications

Architecture from the GGUF header

Architectureqwen4exp
Parameters157B (approximate, mixture of experts)
Layers49
Trained context262,144 tokens
KV cache (fp16)98 KB per token

Source

Quantized byfairfieldt
FamilyQwen
Licenseother
Downloads (HF)22,767
Last updated2026-10-16

Frequently asked questions about Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local)

How much VRAM does Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local) need?

About 106.9 GB at its main file with an 8K context window. That is the 105.6 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local) on an 8 GB GPU?

Not at an 8K context. The smallest file needs about 106.9 GB, so you would need a larger GPU or CPU offloading.

What is the file size of Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local) GGUF?

It depends on the quant: file is 105.6 GB.

What context length does Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local) support?

The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 0.8 GB at 8K and 3.3 GB at 32K.

Where can I download Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local) GGUF?

The files are on Hugging Face in the fairfieldt/Qwen3.8-Flash-Next-NVFP4-QAD-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Qwen3.8-Flash-Next NVFP4 QAD (nvidia/Qwen3.8-Flash-Next-FP4-Local) use?

Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

No. The model requires approximately 106.9 GB of VRAM at 8 k context, far exceeding 8 GB.

Does this model support vision tasks?

No. The GGUF file contains only the language model; vision encoder is not included.

What license applies to this model?

Use is governed by the NVIDIA Open Model Agreement and the Qwen Community License 1.0.

Other GGUFs of Qwen3.8-Flash-Next-FP4-Local

Similar models

Browse all →

More from fairfieldt

All by fairfieldt →

More Qwen models

All Qwen →

Other large models

All large models →