OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata needs about 7.2 GB of memory at its main file (a 6.0 GB file) with an 8K context window, so it fits on a 8 GB GPU. This repository has 3 quants, from 1.3 GB (BF16) to 51.2 GB.
OrcaRouter Qwen3.8-Flash-Next Uncensored NVFP4 GPTQ Strata
OrcaRouter Qwen3.8-Flash-Next Uncensored NVFP4 GPTQ Strata is a 4.95B parameter model based on the Qwen family and the strata-embd architecture. It is quantized from a BF16 checkpoint by GPTQ and packaged for Strata NVFP4. The model removes refusal directions from all residual‑writing matrices, resulting in earlier termination of thinking.
Good at
- BF16 quantization for low‑memory inference
- Uncensored behavior via NVFP4 switch
- Fast inference on RTX 20‑50 series
Limits
- Requires 12 GB VRAM or more for full 125B hybrid MoE
- No vision support
- License is other, not standard
Best for
- Interactive 3D page building
- Code debugging tasks
- Rapid prototyping of text generation
Who it’s for. Developers needing a lightweight, uncensored Qwen variant for GPU‑bound environments. It is suitable for users who prefer a Strata NVFP4 installation and can manage the memory requirements.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| BF16 | 1.3 GB | 1.9 GB | Fits | Get file → | |
| — | 6.0 GB | 7.2 GB | Tight | Get file → | |
| — | 51.2 GB | 57.8 GB | Too big | Get file → |
For 8 GB VRAM, use the BF16 file (1.27 GB, ~1.9 GB memory at 8k context). For 16 GB VRAM, the 5.99 GB quant can be used (~7.2 GB memory). For larger setups, the 51.2 GB file is available (~57.8 GB memory).
What GPU do you need for OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
- 6 GB VRAM: the best quant that fits is BF16 (1.3 GB file, about 1.9 GB in use).
- 8 GB VRAM: the best quant that fits is the main file (6.0 GB file, about 7.2 GB in use).
- 12 GB VRAM: the best quant that fits is the main file (6.0 GB file, about 7.2 GB in use).
- 16 GB VRAM: the best quant that fits is the main file (6.0 GB file, about 7.2 GB in use).
- 24 GB VRAM: the best quant that fits is the main file (6.0 GB file, about 7.2 GB in use).
- 32 GB VRAM: the best quant that fits is the main file (6.0 GB file, about 7.2 GB in use).
- 48 GB VRAM: the best quant that fits is the main file (6.0 GB file, about 7.2 GB in use).
Which OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata quant should you choose?
If memory is tight, the smallest file is BF16 at 1.3 GB, with the quality trade-offs that come with fewer bits. The unquantized model. It gives original quality and needs the most memory, so it is mainly for conversion or reference.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata
How much VRAM does OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata need?
About 7.2 GB at its main file with an 8K context window. That is the 6.0 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata on an 8 GB GPU?
Yes, with the smaller files: the 6.0 GB file needs about 7.2 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata GGUF?
It depends on the quant: BF16 is 1.3 GB, file is 6.0 GB, file is 51.2 GB.
Where can I download OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata GGUF?
The files are on Hugging Face in the Maximilian228/OrcaRouter-Qwen3.8-Flash-Next-Uncensored-NVFP4-GPTQ-Strata repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does OrcaRouter Qwen3.8 Flash Next Uncensored NVFP4 GPTQ Strata use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, the BF16 quant requires about 1.9 GB memory at 8k context, well within 8 GB VRAM.
Does this model support vision tasks?
No, the model has no vision capabilities.
What license does it use?
The model is released under an other license, not a standard open‑source license.