QW

OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4

QwenGGUF by auto7xUpdated 2026-10-08
Download on Hugging Face
Parameters126B
Context—
Layers—
Architectureqwen4exp-mtp
Smallest quant0.9 GB
Quick answer

OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 needs about 1.9 GB of memory at BF16 (a 1.3 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 4 quants, from 0.9 GB (Q2_0) to 73.9 GB.

OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 – 126B parameter LLM

This model is a 126‑billion‑parameter Qwen4exp‑mtp architecture. It is a ModelOpt NVFP4 conversion of OrcaRouter’s uncensored Qwen3.8‑Flash‑Next checkpoint. The model is packaged for local inference with Pennyroyal/SGLang.

Good at

  • Agentic tool use
  • Uncensored text generation
  • Large‑context reasoning

Limits

  • No vision support
  • Requires large VRAM for full precision
  • License is other

Best for

  • Local agentic workflows
  • Tool‑using applications
  • Research on uncensored LLMs

Who it’s for. Users who need a large‑parameter, uncensored Qwen model for local agentic tasks and can run it on compatible hardware. It is suitable for developers and researchers working with Pennyroyal or SGLang.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q2_00.9 GB 1.5 GB
Fits Get file →
BF161.3 GB 1.9 GB
Fits Get file →
—51.2 GB 57.8 GB
Too big Get file →
—73.9 GB 83.3 GB
Too big Get file →

For 8 GB VRAM, use the Q2_0 quantized file (0.89 GB, ~1.5 GB memory at 8 k context). For 16 GB VRAM, the BF16 file (1.27 GB, ~1.9 GB memory) is a good balance between size and quality. Larger memory budgets can use the full‑precision files.

What GPU do you need for OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
  • 6 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
  • 8 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
  • 12 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
  • 16 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
  • 24 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
  • 32 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
  • 48 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).

Which OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 quant should you choose?

BF16 (1.3 GB) is the middle option in this repository. The unquantized model. It gives original quality and needs the most memory, so it is mainly for conversion or reference.

If memory is tight, the smallest file is Q2_0 at 0.9 GB, with the quality trade-offs that come with fewer bits. Use it only when memory is very tight. Expect a clear drop in quality, which is usually worse on small models and easier to live with on large ones.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureqwen4exp-mtp
Parameters126B

Source

Quantized byauto7x
FamilyQwen
Licenseother
Downloads (HF)21,839
Last updated2026-10-08

Frequently asked questions about OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4

How much VRAM does OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 need?

About 1.9 GB at BF16 with an 8K context window. That is the 1.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 on an 8 GB GPU?

Yes, with BF16: the 1.3 GB file needs about 1.9 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 GGUF?

It depends on the quant: Q2_0 is 0.9 GB, BF16 is 1.3 GB, file is 51.2 GB, file is 73.9 GB.

Where can I download OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 GGUF?

The files are on Hugging Face in the auto7x/OrcaRouter-Qwen3.8-Flash-Next-Uncensored-ModelOpt-NVFP4-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does OrcaRouter Qwen3.8 Flash Next Uncensored ModelOpt NVFP4 use?

Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, using the Q2_0 quantized file which is 0.89 GB and requires about 1.5 GB of VRAM at 8 k context.

Does this model support vision?

No, the model does not include vision capabilities.

What is the context length of this model?

The trained context tokens are not specified in the provided data.

Other GGUFs of Qwen3.8-Flash-Next

Similar models

Browse all →

More Qwen models

All Qwen →

Other large models

All large models →