DE

DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS

DeepSeekGGUF by AbirayUpdated 2026-10-24
Download on Hugging Face
Parameters197B
Context—
Layers—
Architecturedeepseek41-engram
Smallest quant110.6 GB
Quick answer

DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS needs about 124.4 GB of memory at IQ4_NL (a 110.6 GB file) with an 8K context window, which is more than a 48 GB GPU holds. This repository has 2 quants, from 110.6 GB (IQ4_NL) to 138.6 GB (IQ2_XXS).

DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS – 763B sparse MoE GGUF

This model is a 763.2B‑parameter sparse mixture‑of‑experts with 384 routed experts per layer and a 1M‑token context window. It is distributed as a 4‑shard GGUF with an Engram lookup file. The quantizations use non‑uniform GSQ‑RCO and are available in IQ4_NL and IQ2_XXS.

Good at

  • 1M‑token context
  • Sparse MoE architecture
  • Large parameter count

Limits

  • Requires a single 12 GB GPU
  • No LoRA adapters needed at runtime
  • MIT license

Best for

  • Long‑form reasoning
  • Document summarization
  • Complex dialogue

Who it’s for. Engineers and researchers needing a large‑context LLM that runs on a single 12 GB GPU. The model is ready to use without additional adapters.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
IQ4_NL110.6 GB 124.4 GB
Too big Get file →
IQ2_XXS138.6 GB (4 parts) 155.7 GB
Too big Get file →

For a 12 GB GPU, the IQ4_NL build (110.6 GB file, 124.4 GB memory at 8 k context) is the smallest. The IQ2_XXS build (138.58 GB file, 155.7 GB memory at 8 k context) offers higher precision but needs more memory. Both are split into four shards; download the Engram file (110.60 GB) once and place it with the shards.

What GPU do you need for DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: no quant fits at an 8K context.
  • 8 GB VRAM: no quant fits at an 8K context.
  • 12 GB VRAM: no quant fits at an 8K context.
  • 16 GB VRAM: no quant fits at an 8K context.
  • 24 GB VRAM: no quant fits at an 8K context.
  • 32 GB VRAM: no quant fits at an 8K context.
  • 48 GB VRAM: no quant fits at an 8K context.

Which DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS quant should you choose?

IQ4_NL (110.6 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturedeepseek41-engram
Parameters197B

Source

Quantized byAbiray
FamilyDeepSeek
Licensemit
Downloads (HF)171,902
Last updated2026-10-24

Frequently asked questions about DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS

How much VRAM does DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS need?

About 124.4 GB at IQ4_NL with an 8K context window. That is the 110.6 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS on an 8 GB GPU?

Not at an 8K context. The smallest file needs about 124.4 GB, so you would need a larger GPU or CPU offloading.

What is the file size of DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS GGUF?

It depends on the quant: IQ4_NL is 110.6 GB, IQ2_XXS is 138.6 GB.

Where can I download DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS GGUF?

The files are on Hugging Face in the Abiray/DeepSeek-V4.1-Flash-1017-Uncensored-GSQ-RCO-IQ2_XXS-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does DeepSeek V4.1 Flash 1017 Uncensored GSQ RCO IQ2 XXS use?

Hugging Face lists the license as mit. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on a 12 GB GPU?

Yes, the model is designed to run on a single 12 GB GPU with the provided shards and Engram file.

Do I need to load LoRA adapters?

No, all abliterated tensors are baked into the backbone shards; no LoRA is required.

Is there a vision capability?

No vision support is provided in this GGUF build.

Other GGUFs of DeepSeek-V4.1-Flash-1017-GSQ-RCO-GGUF

Similar models

Browse all →

More from Abiray

All by Abiray →

More DeepSeek models

All DeepSeek →

Other large models

All large models →