Qwen3.8 Flash Next needs about 82.8 GB of memory at Q2_0 (a 81.5 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 2 quants, from 81.5 GB (Q2_0) to 105.8 GB (Q4_0). Longer context needs more: at 32K tokens the KV cache alone adds about 3.2 GB.
Qwen3.8 Flash Next – 177B parameter LLM with hybrid attention and n‑gram embedding
Qwen3.8 Flash Next is an experimental preview of the Qwen4 architecture. It features hybrid attention with QSA, gated residuals, and n‑gram embeddings. The model supports a 262144‑token context window and is available in two GGUF quantizations.
Good at
- Hybrid attention for long‑context latency reduction
- Efficient n‑gram embedding for memory‑constrained accelerators
- Large 262144‑token context window
Limits
- Requires large VRAM – >82.8 GB at 8k context
- No vision capability
- License is other, not open source
Best for
- Long‑context document summarization
- Agentic workloads with extended context
- Memory‑constrained inference on AMD Strix Halo
Who it’s for. Developers and researchers needing a 177 B parameter model with a 262144‑token context window. Suitable for AMD Strix Halo systems with 64 GB or 128 GB unified memory.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q2_0 | 81.5 GB (2 parts) | 82.8 GB | Too big | Get file → | |
| Q4_0 | 105.8 GB (3 parts) | 107.1 GB | Too big | Get file → |
For 128 GB systems, use the Q4_0 quantization (105.75 GB file, 107.1 GB memory at 8k context). For 64 GB systems, use the Q2_0 quantization (81.47 GB file, 82.8 GB memory at 8k context).
What GPU do you need for Qwen3.8 Flash Next?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: no quant fits at an 8K context.
- 32 GB VRAM: no quant fits at an 8K context.
- 48 GB VRAM: no quant fits at an 8K context.
Which Qwen3.8 Flash Next quant should you choose?
Q2_0 (81.5 GB) is the middle option in this repository. Use it only when memory is very tight. Expect a clear drop in quality, which is usually worse on small models and easier to live with on large ones.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Qwen3.8 Flash Next
How much VRAM does Qwen3.8 Flash Next need?
About 82.8 GB at Q2_0 with an 8K context window. That is the 81.5 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Qwen3.8 Flash Next on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 82.8 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Qwen3.8 Flash Next GGUF?
It depends on the quant: Q2_0 is 81.5 GB, Q4_0 is 105.8 GB.
What context length does Qwen3.8 Flash Next support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 0.8 GB at 8K and 3.2 GB at 32K.
Where can I download Qwen3.8 Flash Next GGUF?
The files are on Hugging Face in the pugant/Qwen3.8-Flash-Next-ROCMFP4_STRIX_LEAN-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Qwen3.8 Flash Next use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Qwen3.8 Flash Next on 8 GB VRAM?
No. The smallest quantization requires at least 82.8 GB of VRAM at 8k context.
Which quantization should I use for a 64 GB system?
Use the Q2_0 quantization; it fits within the 64 GB memory budget with an estimated 82.8 GB usage at 8k context.
Does Qwen3.8 Flash Next support vision tasks?
No, the model has no vision capability.