QW

Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata

QwenGGUF by alesha-proUpdated 2026-10-07
Download on Hugging Face
Parameters—
Context—
Layers—
Architecturecontrolvector
Smallest quant0.0 GB
Quick answer

Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata needs about 0.5 GB of memory at its main file (a 0.0 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.0 GB to 58.4 GB (IQ1_M).

Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata – a compressed code‑centric model

This release compresses Qwen3.8‑Flash‑Next by removing half of its experts and storing the remaining weights at 3.5 bpw. The model size is 58.41 GB with two shards, and the resident working set fits in a single 32 GB accelerator. It retains strong code, agentic, vision, and spatial reasoning abilities.

Good at

  • Code generation and debugging
  • Agentic tool use
  • Vision and spatial reasoning

Limits

  • Reduced non‑code performance
  • No general‑purpose language coverage
  • Requires 58 GB download

Best for

  • Developers needing code‑centric LLMs
  • Agents that use vision and tools
  • Projects with 32 GB VRAM

Who it’s for. Engineers and researchers who need a compact, code‑focused model and have a 32 GB accelerator. It is suitable for projects that prioritize coding, agentic workflows, and vision tasks over general language coverage.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.0 GB 0.5 GB
Fits Get file →
IQ1_M58.4 GB (2 parts) 65.9 GB
Too big Get file →

The only available quant is IQ1_M, 58.41 GB. It requires approximately 65.9 GB of VRAM at 8 k context. If your GPU has 32 GB, you must stream the model or use a larger GPU. No other quants are provided.

What GPU do you need for Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 6 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 8 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 12 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 16 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 24 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 32 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 48 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).

Specifications

Architecture from the GGUF header

Architecturecontrolvector

Source

Quantized byalesha-pro
FamilyQwen
Licenseother
Downloads (HF)21,211
Last updated2026-10-07

Frequently asked questions about Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata

How much VRAM does Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata need?

About 0.5 GB at its main file with an 8K context window. That is the 0.0 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata on an 8 GB GPU?

Yes, with the smaller files: the 0.0 GB file needs about 0.5 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata GGUF?

It depends on the quant: file is 0.0 GB, IQ1_M is 58.4 GB.

Where can I download Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata GGUF?

The files are on Hugging Face in the alesha-pro/Qwen3.8-Flash-Next-abliterated-GSQ-RCO-Coder-Strata-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Qwen3.8 Flash Next abliterated GSQ RCO Coder Strata use?

Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

No. The IQ1_M quant requires about 65.9 GB of VRAM at 8 k context, far above 8 GB.

Does this model support vision?

Yes, it retains vision capability, but performance may be reduced compared to the full model.

What is the download size?

The model consists of two shards totaling 58.41 GB.

Other GGUFs of Qwen3.8-Flash-Next-GSQ-RCO-Coder-GGUF

More from alesha-pro

All by alesha-pro →

More Qwen models

All Qwen →