QW

Qwen3.8 Flash Next abliterated GGUF IQ4XS

QwenGGUF by wy2payUpdated 2026-10-11
Download on Hugging Face
Parameters53M
Context—
Layers—
Architectureqwen4exp
Smallest quant0.2 GB
Quick answer

Qwen3.8 Flash Next abliterated GGUF IQ4XS needs about 5.1 GB of memory at its main file (a 4.1 GB file) with an 8K context window, so it fits on a 6 GB GPU. This repository has 3 quants, from 0.2 GB to 97.5 GB (IQ4_XS).

Qwen3.8 Flash Next Abliterated GGUF IQ4_XS

Qwen3.8 Flash Next Abliterated is a 53.1 billion‑parameter model in the Qwen family, using the qwen4exp architecture. The GGUF file is quantized to IQ4_XS and split into three shards. It is tailored for DGX Spark with 128 GB unified memory.

Good at

  • Large context handling
  • Fine‑tuned LoRA for specific tasks
  • Efficient memory usage with IQ4_XS

Limits

  • Requires 128 GB unified memory for full 1M context
  • No vision support
  • License not specified

Best for

  • Deploying on DGX Spark systems
  • Running long‑form generation up to 1M tokens
  • Fine‑tuned LoRA applications

Who it’s for. Engineers and researchers needing a high‑capacity Qwen model on DGX Spark hardware. The model is suitable for workloads that benefit from large context and fine‑tuned LoRA.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.2 GB 0.7 GB
Fits Get file →
—4.1 GB 5.1 GB
Fits Get file →
IQ4_XS97.5 GB (3 parts) 109.7 GB
Too big Get file →

For 128 GB unified memory, use the IQ4_XS quantized file (97.47 GB) with KV cache of ~25 GB. This fits within 122–130 GB. For smaller memory budgets, consider the 4.14 GB file, but it lacks the IQ4_XS quantization. Estimates are approximate.

What GPU do you need for Qwen3.8 Flash Next abliterated GGUF IQ4XS?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.2 GB file, about 0.7 GB in use).
  • 6 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
  • 8 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
  • 12 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
  • 16 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
  • 24 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
  • 32 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
  • 48 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).

Which Qwen3.8 Flash Next abliterated GGUF IQ4XS quant should you choose?

If memory is tight, the smallest file is the first one in the table at 0.2 GB, with the quality trade-offs that come with fewer bits.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureqwen4exp
Parameters53M

Source

Quantized bywy2pay
FamilyQwen
Downloads (HF)22,794
Last updated2026-10-11

Frequently asked questions about Qwen3.8 Flash Next abliterated GGUF IQ4XS

How much VRAM does Qwen3.8 Flash Next abliterated GGUF IQ4XS need?

About 5.1 GB at its main file with an 8K context window. That is the 4.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Qwen3.8 Flash Next abliterated GGUF IQ4XS on an 8 GB GPU?

Yes, with the smaller files: the 4.1 GB file needs about 5.1 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of Qwen3.8 Flash Next abliterated GGUF IQ4XS GGUF?

It depends on the quant: file is 0.2 GB, file is 4.1 GB, IQ4_XS is 97.5 GB.

Where can I download Qwen3.8 Flash Next abliterated GGUF IQ4XS GGUF?

The files are on Hugging Face in the wy2pay/Qwen3.8-Flash-Next-abliterated-GGUF-IQ4XS repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

Can I run this model on 8 GB VRAM?

No, the model requires 128 GB unified memory for full 1M context. Smaller contexts may fit with lower memory but the full model is not supported on 8 GB VRAM.

What is the context length supported?

The model supports up to 1M tokens with YaRN ×4, but recommended context for 128 GB is 512K tokens.

Does it support vision tasks?

No, the model has no vision capabilities.

Similar models

Browse all →

More from wy2pay

All by wy2pay →

More Qwen models

All Qwen →

Other tiny models

All tiny models →