QW

Sakura Qwen3.8 Flash Next Swift 3bit 352E

QwenGGUF by webmp3Updated 2026-10-08
Download on Hugging Face
Parameters139B
Context256K
Layers48
Architectureqwen4exp
Smallest quant62.5 GB
Quick answer

Sakura Qwen3.8 Flash Next Swift 3bit 352E needs about 63.8 GB of memory at IQ3_XXS (a 62.5 GB file) with an 8K context window, which is more than a 48 GB GPU holds. Longer context needs more: at 32K tokens the KV cache alone adds about 3.2 GB.

Sakura Qwen3.8 Flash Next Swift 3bit 352E – 139B Qwen model with expert pruning

Sakura Qwen3.8 Flash Next Swift 3bit 352E is a 139B Qwen model fine‑tuned with Swift 1.5 and quantized to IQ3_XXS. It keeps 352 of 512 experts per layer and targets short reasoning traces, coding, and agentic tasks. The GGUF file is 62.48 GB and requires about 63.8 GB of VRAM at 8k context.

Good at

  • Reasoning‑efficient short traces
  • Coding and agentic tasks
  • Expert‑pruned performance

Limits

  • 32 GB GPU not sufficient
  • Requires 64 GB unified memory
  • No official vision support

Best for

  • Long‑form reasoning with limited tokens
  • Agentic task execution
  • Code generation in constrained environments

Who it’s for. Developers and researchers needing a large Qwen model with reduced thinking tokens and expert pruning. Ideal for teams with 64 GB GPUs who want efficient reasoning and coding capabilities.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
IQ3_XXS62.5 GB (2 parts) 63.8 GB
Too big Get file →

For a 64 GB GPU, use the IQ3_XXS quantization; it needs about 63.8 GB of VRAM at 8k context. For a 32 GB GPU, the 2.5‑bit sibling is required. The file size is 62.48 GB, split into two shards.

What GPU do you need for Sakura Qwen3.8 Flash Next Swift 3bit 352E?

These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: no quant fits at an 8K context.
  • 8 GB VRAM: no quant fits at an 8K context.
  • 12 GB VRAM: no quant fits at an 8K context.
  • 16 GB VRAM: no quant fits at an 8K context.
  • 24 GB VRAM: no quant fits at an 8K context.
  • 32 GB VRAM: no quant fits at an 8K context.
  • 48 GB VRAM: no quant fits at an 8K context.

Which Sakura Qwen3.8 Flash Next Swift 3bit 352E quant should you choose?

IQ3_XXS (62.5 GB) is the middle option in this repository. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureqwen4exp
Parameters139B (approximate, mixture of experts)
Layers48
Trained context262,144 tokens
KV cache (fp16)96 KB per token

Source

Quantized bywebmp3
FamilyQwen
Licenseother
Downloads (HF)758
Last updated2026-10-08

Frequently asked questions about Sakura Qwen3.8 Flash Next Swift 3bit 352E

How much VRAM does Sakura Qwen3.8 Flash Next Swift 3bit 352E need?

About 63.8 GB at IQ3_XXS with an 8K context window. That is the 62.5 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Sakura Qwen3.8 Flash Next Swift 3bit 352E on an 8 GB GPU?

Not at an 8K context. The smallest file needs about 63.8 GB, so you would need a larger GPU or CPU offloading.

What is the file size of Sakura Qwen3.8 Flash Next Swift 3bit 352E GGUF?

It depends on the quant: IQ3_XXS is 62.5 GB.

What context length does Sakura Qwen3.8 Flash Next Swift 3bit 352E support?

The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 0.8 GB at 8K and 3.2 GB at 32K.

Where can I download Sakura Qwen3.8 Flash Next Swift 3bit 352E GGUF?

The files are on Hugging Face in the webmp3/Sakura-Qwen3.8-Flash-Next-Swift-3bit-352E-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Sakura Qwen3.8 Flash Next Swift 3bit 352E use?

Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on an 8 GB VRAM GPU?

No, the model requires about 63.8 GB of VRAM at 8k context.

Can I run this model on a 32 GB GPU?

No, the 32 GB GPU is insufficient; the 2.5‑bit sibling is needed.

Can I run this model on a 64 GB GPU?

Yes, the IQ3_XXS quantization fits a 64 GB GPU with unified memory.

Other GGUFs of Swift-1.5-Qwen3.8-Flash-Next-GSQ-RCO-GGUF

Similar models

Browse all →

More from webmp3

All by webmp3 →

More Qwen models

All Qwen →

Other large models

All large models →