Qwen3.8 Flash Next Uncensored needs about 133.9 GB of memory at Q4_K_M (a 119.2 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 18 quants, from 4.1 GB to 191.0 GB (Q8_0).
Qwen3.8 Flash Next Uncensored – 190B parameter LLM with vision, reasoning, and tools support
Qwen3.8 Flash Next Uncensored is a 190 billion‑parameter model from the Qwen family. It supports reasoning, tools, and vision tasks. The model is released under the Apache‑2.0 license and is available in multiple GGUF quantizations.
Good at
- Reasoning and complex problem solving
- Tool usage and API integration
- Vision‑enabled text generation
Limits
- No official vision API support in llama.cpp
- Large memory requirement for higher‑quality quants
- Requires 8 k context for memory estimates
Best for
- Developing AI agents that need tool calls
- Building vision‑enabled chatbots
- Running inference on high‑performance GPUs
Who it’s for. Engineers and researchers who need a large, versatile LLM with vision and tool capabilities. The model is suitable for advanced AI applications that require reasoning and multimodal inputs.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 4.1 GB | 5.1 GB | Fits | Get file → | |
| IQ2_XXS | 74.8 GB (2 parts) | 84.3 GB | Too big | Get file → | |
| IQ2_M | 80.1 GB (2 parts) | 90.2 GB | Too big | Get file → | |
| Q2_K | 80.4 GB (2 parts) | 90.6 GB | Too big | Get file → | |
| IQ3_XXS | 85.2 GB (2 parts) | 95.9 GB | Too big | Get file → | |
| Q3_K_S | 88.8 GB (2 parts) | 99.9 GB | Too big | Get file → | |
| IQ3_M | 89.5 GB (2 parts) | 100.8 GB | Too big | Get file → | |
| Q3_K_M | 94.1 GB (3 parts) | 105.9 GB | Too big | Get file → | |
| Q3_K_L | 96.7 GB (3 parts) | 108.8 GB | Too big | Get file → | |
| IQ4_XS | 97.5 GB (3 parts) | 109.7 GB | Too big | Get file → | |
| IQ4_XS | 100.2 GB (3 parts) | 112.8 GB | Too big | Get file → | |
| Q4_K_S | 111.8 GB (3 parts) | 125.7 GB | Too big | Get file → | |
| Q4_K_M | 119.2 GB (3 parts) | 133.9 GB | Too big | Get file → | |
| Q5_K_S | 127.7 GB (3 parts) | 143.6 GB | Too big | Get file → | |
| Q5_K_M | 134.1 GB (3 parts) | 150.7 GB | Too big | Get file → | |
| Q6_K | 167.6 GB (5 parts) | 188.3 GB | Too big | Get file → | |
| Q8_0 | 188.2 GB (5 parts) | 211.3 GB | Too big | Get file → | |
| Q8_0 | 191.0 GB (5 parts) | 214.4 GB | Too big | Get file → |
For 8 GB VRAM, use IQ2_XXS or IQ2_M quants; they need about 84–90 GB of memory at 8 k context. For 16 GB VRAM, Q4_K_S or Q4_K_M are suitable, requiring roughly 126–134 GB. For larger GPUs, Q5_K_M or Q6_K provide higher quality with 151–188 GB memory usage. Estimates are approximate.
What GPU do you need for Qwen3.8 Flash Next Uncensored?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
- 8 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
- 12 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
- 16 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
- 24 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
- 32 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
- 48 GB VRAM: the best quant that fits is the main file (4.1 GB file, about 5.1 GB in use).
Which Qwen3.8 Flash Next Uncensored quant should you choose?
Q4_K_M is the usual starting point for Qwen3.8 Flash Next Uncensored: it balances file size and quality well. Here it is a 119.2 GB file.
The Q8_0 file is 188.2 GB, about 1.6 times the size of Q4_K_M. It keeps the weights closer to the original, which only matters if you have the memory to spare.
If memory is tight, the smallest file is the first one in the table at 4.1 GB, with the quality trade-offs that come with fewer bits.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Qwen3.8 Flash Next Uncensored
How much VRAM does Qwen3.8 Flash Next Uncensored need?
About 133.9 GB at Q4_K_M with an 8K context window. That is the 119.2 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Qwen3.8 Flash Next Uncensored on an 8 GB GPU?
Yes, with the smaller files: the 4.1 GB file needs about 5.1 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Qwen3.8 Flash Next Uncensored GGUF?
It depends on the quant: file is 4.1 GB, IQ2_XXS is 74.8 GB, IQ2_M is 80.1 GB, Q2_K is 80.4 GB, IQ3_XXS is 85.2 GB, Q3_K_S is 88.8 GB and 12 more.
What context length does Qwen3.8 Flash Next Uncensored support?
The GGUF header lists a trained context length of 262,144 tokens (256K).
Where can I download Qwen3.8 Flash Next Uncensored GGUF?
The files are on Hugging Face in the orcarouter/Qwen3.8-Flash-Next-Uncensored-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Qwen3.8 Flash Next Uncensored use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Qwen3.8 Flash Next Uncensored on 8 GB VRAM?
Only the lowest‑quality quants such as IQ2_XXS or IQ2_M can fit, but they still need around 84–90 GB of memory at 8 k context, so 8 GB VRAM is insufficient.
Does this model support vision tasks in llama.cpp?
The model has vision capabilities, but llama.cpp does not provide official vision support for this GGUF file.
What license applies to this model?
The model is released under the Apache‑2.0 license, allowing free use and modification.