DE

Huihui DeepSeek V4 Flash Vision Exp abliterated

DeepSeekGGUF by taurusduanUpdated 2026-10-13
Download on Hugging Face
Parameters284B
Context—
Layers—
Architecturedeepseek4
Smallest quant135.3 GB
Quick answer

Huihui DeepSeek V4 Flash Vision Exp abliterated needs about 170.2 GB of memory at Q4_K (a 151.5 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 3 quants, from 135.3 GB (Q3_K) to 156.4 GB (BF16).

Huihui DeepSeek V4 Flash Vision Exp abliterated – a large multimodal model with reduced safety filtering

This model is a 284‑billion‑parameter DeepSeek V4 Flash Vision Exp with layers 11‑28 ablated. It is released under the MIT license and is intended for research and controlled testing. The model is available in GGUF format with Q3_K, Q4_K, and BF16 quantizations.

Good at

  • Multimodal text and image understanding
  • Large‑scale language generation
  • Experimental safety‑filter removal

Limits

  • Requires >150 GB VRAM for any quant
  • No vision support warnings omitted – still multimodal
  • Not suitable for production use

Best for

  • Research on multimodal LLMs
  • Testing safety‑filter removal techniques
  • Controlled environment experimentation

Who it’s for. Researchers and developers who need a large multimodal model for experimentation. The model is not intended for public or commercial deployment due to reduced safety filtering.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q3_K135.3 GB 152.1 GB
Too big Get file →
Q4_K151.5 GB 170.2 GB
Too big Get file →
BF16156.4 GB 175.6 GB
Too big Get file →

The Q3_K quant is the smallest at 135.32 GB file size and needs about 152.1 GB VRAM at 8 k context. Q4_K and BF16 are larger. All estimates are approximate; choose the smallest quant if memory is limited.

What GPU do you need for Huihui DeepSeek V4 Flash Vision Exp abliterated?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: no quant fits at an 8K context.
  • 8 GB VRAM: no quant fits at an 8K context.
  • 12 GB VRAM: no quant fits at an 8K context.
  • 16 GB VRAM: no quant fits at an 8K context.
  • 24 GB VRAM: no quant fits at an 8K context.
  • 32 GB VRAM: no quant fits at an 8K context.
  • 48 GB VRAM: no quant fits at an 8K context.

Which Huihui DeepSeek V4 Flash Vision Exp abliterated quant should you choose?

Q4_K (151.5 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.

If memory is tight, the smallest file is Q3_K at 135.3 GB, with the quality trade-offs that come with fewer bits. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturedeepseek4
Parameters284B

Source

Quantized bytaurusduan
FamilyDeepSeek
Licensemit
Downloads (HF)1,054
Last updated2026-10-13

Frequently asked questions about Huihui DeepSeek V4 Flash Vision Exp abliterated

How much VRAM does Huihui DeepSeek V4 Flash Vision Exp abliterated need?

About 170.2 GB at Q4_K with an 8K context window. That is the 151.5 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Huihui DeepSeek V4 Flash Vision Exp abliterated on an 8 GB GPU?

Not at an 8K context. The smallest file needs about 152.1 GB, so you would need a larger GPU or CPU offloading.

What is the file size of Huihui DeepSeek V4 Flash Vision Exp abliterated GGUF?

It depends on the quant: Q3_K is 135.3 GB, Q4_K is 151.5 GB, BF16 is 156.4 GB.

Where can I download Huihui DeepSeek V4 Flash Vision Exp abliterated GGUF?

The files are on Hugging Face in the taurusduan/Huihui-DeepSeek-V4-Flash-Vision-Exp-abliterated-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Huihui DeepSeek V4 Flash Vision Exp abliterated use?

Hugging Face lists the license as mit. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

No. Even the smallest quant needs over 150 GB VRAM at 8 k context.

Does it support vision input?

Yes, it is a multimodal model with vision capabilities.

Is it safe for production use?

No. The safety filtering is significantly reduced; use only in controlled research settings.

Other GGUFs of DeepSeek-V4-Flash-Vision-Exp

Similar models

Browse all →

More from taurusduan

All by taurusduan →

More DeepSeek models

All DeepSeek →

Other large models

All large models →