QW

Qwen3.8-Flash-CIRU-STRIX-IU4-MTP

QwenGGUF by jcbtcUpdated 2026-10-07
Download on Hugging Face
Parameters126B
Context256K
Layers49
Architectureqwen4exp
Smallest quant4.1 GB
Quick answer

Qwen3.8-Flash-CIRU-STRIX-IU4-MTP needs about 73.4 GB of memory at its main file (a 72.1 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 3 quants, from 4.1 GB (Q8_0) to 79.4 GB. Longer context needs more: at 32K tokens the KV cache alone adds about 3.3 GB.

Qwen3.8-Flash-CIRU-STRIX-IU4-MTP – 126B parameter LLM with vision support

This model is a 126‑billion‑parameter Qwen4exp architecture with vision capability. It supports a 262,144‑token context window and is available in GGUF format. The model is released under an other license and requires a custom CIRU runtime for AMD Strix Halo.

Good at

  • Large context handling
  • Vision input
  • Multi‑token prediction

Limits

  • Requires custom CIRU runtime
  • No standard llama.cpp support
  • Large memory footprint

Best for

  • Long‑form content generation
  • Image‑guided text tasks
  • Research on hybrid attention models

Who it’s for. Developers and researchers needing a high‑parameter LLM with extended context and vision support. The model is suited for environments that can run the custom CIRU runtime and manage its memory demands.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q8_04.1 GB 5.5 GB
Fits Get file →
—72.1 GB 73.4 GB
Too big Get file →
—79.4 GB 80.7 GB
Too big Get file →

For 8 k context, the Q8_0 quant file is 4.14 GB and needs about 5.5 GB of VRAM. If larger memory is available, the 72.11 GB file requires about 73.4 GB VRAM, and the 79.4 GB file needs about 80.7 GB VRAM. Choose the smallest file that fits your GPU budget.

What GPU do you need for Qwen3.8-Flash-CIRU-STRIX-IU4-MTP?

These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: the best quant that fits is Q8_0 (4.1 GB file, about 5.5 GB in use).
  • 8 GB VRAM: the best quant that fits is Q8_0 (4.1 GB file, about 5.5 GB in use).
  • 12 GB VRAM: the best quant that fits is Q8_0 (4.1 GB file, about 5.5 GB in use).
  • 16 GB VRAM: the best quant that fits is Q8_0 (4.1 GB file, about 5.5 GB in use).
  • 24 GB VRAM: the best quant that fits is Q8_0 (4.1 GB file, about 5.5 GB in use).
  • 32 GB VRAM: the best quant that fits is Q8_0 (4.1 GB file, about 5.5 GB in use).
  • 48 GB VRAM: the best quant that fits is Q8_0 (4.1 GB file, about 5.5 GB in use).

Which Qwen3.8-Flash-CIRU-STRIX-IU4-MTP quant should you choose?

If memory is tight, the smallest file is Q8_0 at 4.1 GB, with the quality trade-offs that come with fewer bits. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureqwen4exp
Parameters126B (approximate, mixture of experts)
Layers49
Trained context262,144 tokens
KV cache (fp16)98 KB per token

Source

Quantized byjcbtc
FamilyQwen
Licenseother
Downloads (HF)3,161
Last updated2026-10-07

Frequently asked questions about Qwen3.8-Flash-CIRU-STRIX-IU4-MTP

How much VRAM does Qwen3.8-Flash-CIRU-STRIX-IU4-MTP need?

About 73.4 GB at its main file with an 8K context window. That is the 72.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Qwen3.8-Flash-CIRU-STRIX-IU4-MTP on an 8 GB GPU?

Yes, with Q8_0: the 4.1 GB file needs about 5.5 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of Qwen3.8-Flash-CIRU-STRIX-IU4-MTP GGUF?

It depends on the quant: Q8_0 is 4.1 GB, file is 72.1 GB, file is 79.4 GB.

What context length does Qwen3.8-Flash-CIRU-STRIX-IU4-MTP support?

The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 0.8 GB at 8K and 3.3 GB at 32K.

Where can I download Qwen3.8-Flash-CIRU-STRIX-IU4-MTP GGUF?

The files are on Hugging Face in the jcbtc/Qwen3.8-Flash-CIRU-STRIX-IU4 repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Qwen3.8-Flash-CIRU-STRIX-IU4-MTP use?

Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

The smallest quantized file requires 5.5 GB VRAM at 8 k context, so 8 GB VRAM is sufficient for that version.

Does this model support image input?

Yes, the model includes vision capability and requires the custom CIRU runtime for image handling.

Is the model compatible with standard llama.cpp?

No, standard llama.cpp does not support the compact expert format or the required SSD‑paged embedding table.

Other GGUFs of Qwen3.8-Flash-Next

Similar models

Browse all →

More from jcbtc

All by jcbtc →

More Qwen models

All Qwen →

Other large models

All large models →