Huihui Qwen3.8 Flash Next abliterated i1 needs about 100.0 GB of memory at IQ3_S (a 88.9 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 8 quants, from 0.6 GB to 97.5 GB (IQ4_XS).
190B Qwen3.8 Flash Next model with reduced safety filtering
Huihui Qwen3.8 Flash Next abliterated i1 is a 190 billion‑parameter LLM released as a GGUF file. It removes refusal filtering, making it suitable for research and controlled environments. The model is available in multiple quantizations ranging from 0.58 GB to 97.47 GB.
Good at
- Large context handling
- High‑capacity language modeling
- Research‑grade experimentation
Limits
- Reduced safety filtering
- Not for public or commercial use
- Requires careful monitoring
Best for
- Controlled research experiments
- Testing safety‑filter removal
- Exploring large‑parameter LLM behavior
Who it’s for. Researchers and developers who need a large LLM without standard safety filters for controlled testing. Use in secure, monitored environments only.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.6 GB | 1.1 GB | Fits | Get file → | |
| Q2_K | 80.4 GB | 90.6 GB | Too big | Get file → | |
| Q3_K_S | 88.8 GB | 99.9 GB | Too big | Get file → | |
| IQ3_S | 88.9 GB | 100.0 GB | Too big | Get file → | |
| IQ3_M | 89.5 GB | 100.8 GB | Too big | Get file → | |
| Q3_K_M | 94.1 GB | 105.9 GB | Too big | Get file → | |
| Q3_K_L | 96.7 GB | 108.8 GB | Too big | Get file → | |
| IQ4_XS | 97.5 GB | 109.7 GB | Too big | Get file → |
For 8 GB VRAM, use the 0.58 GB quant. For 90 GB VRAM, Q2_K (80.45 GB) is suitable. For larger budgets, Q3_K_L (96.66 GB) or IQ4_XS (97.47 GB) provide higher quality with similar memory usage.
What GPU do you need for Huihui Qwen3.8 Flash Next abliterated i1?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
- 6 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
- 8 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
- 12 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
- 16 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
- 24 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
- 32 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
- 48 GB VRAM: the best quant that fits is the main file (0.6 GB file, about 1.1 GB in use).
Which Huihui Qwen3.8 Flash Next abliterated i1 quant should you choose?
IQ3_S (88.9 GB) is the middle option in this repository. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.
If memory is tight, the smallest file is the first one in the table at 0.6 GB, with the quality trade-offs that come with fewer bits.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Frequently asked questions about Huihui Qwen3.8 Flash Next abliterated i1
How much VRAM does Huihui Qwen3.8 Flash Next abliterated i1 need?
About 100.0 GB at IQ3_S with an 8K context window. That is the 88.9 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Huihui Qwen3.8 Flash Next abliterated i1 on an 8 GB GPU?
Yes, with the smaller files: the 0.6 GB file needs about 1.1 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Huihui Qwen3.8 Flash Next abliterated i1 GGUF?
It depends on the quant: file is 0.6 GB, Q2_K is 80.4 GB, Q3_K_S is 88.8 GB, IQ3_S is 88.9 GB, IQ3_M is 89.5 GB, Q3_K_M is 94.1 GB and 2 more.
Where can I download Huihui Qwen3.8 Flash Next abliterated i1 GGUF?
The files are on Hugging Face in the mradermacher/Huihui-Qwen3.8-Flash-Next-abliterated-i1-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Huihui Qwen3.8 Flash Next abliterated i1 use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, the 0.58 GB quant can run on 8 GB VRAM with an estimated 1.1 GB memory usage at 8k context.
Is this model safe for public deployment?
No. The safety filtering is significantly reduced; it is intended for research and controlled environments only.
What quant should I use for best quality?
IQ4_XS offers high quality with a 97.47 GB file size, but requires substantial VRAM.