QW

Qwen3.8 9B Distill uncensored heretic

QwenGGUF by nuofangUpdated 2026-08-28
Download on Hugging Face
Parameters1M
Context—
Layers—
Architecture—
Smallest quant0.0 GB
Quick answer

Qwen3.8 9B Distill uncensored heretic needs about 6.3 GB of memory at IQ4_XS (a 5.2 GB file) with an 8K context window, so it fits on a 8 GB GPU. This repository has 3 quants, from 0.0 GB to 6.5 GB (Q5_K_M).

Qwen3.8 9B Distill uncensored heretic – a 9B distilled model with 262,144‑token context

Qwen3.8-9B-Distill-uncensored-heretic is a full‑parameter distillation of Qwen3.8 2.4T A95B into the Qwen3.5‑9B architecture. It retains the 262,144‑token native context and supports native function calling. The model was trained on ~70,000 curated teacher traces focused on mathematics, code, and reasoning.

Good at

  • Distilled chain‑of‑thought reasoning
  • Mathematics and code tasks
  • Native function calling

Limits

  • No vision support
  • License not specified
  • Large VRAM required for full precision

Best for

  • Deploying on a single GPU
  • Fine‑tuning for math and code
  • Function‑calling applications

Who it’s for. Developers and researchers who need a compact model with strong reasoning and code abilities, and who can run it on a single GPU. The model is suitable for applications requiring long‑context handling and function calling.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.0 GB 0.5 GB
Fits Get file →
IQ4_XS5.2 GB 6.3 GB
Fits Get file →
Q5_K_M6.5 GB 7.7 GB
Tight Get file →

For 8 GB VRAM use the IQ4_XS quant (5.2 GB file, 6.3 GB memory at 8 k context). For 12 GB VRAM the Q5_K_M quant (6.47 GB file, 7.7 GB memory) is recommended. The unknown quant is only 0.01 GB but memory estimate is 0.5 GB at 8 k context.

What GPU do you need for Qwen3.8 9B Distill uncensored heretic?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 6 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
  • 8 GB VRAM: the best quant that fits is Q5_K_M (6.5 GB file, about 7.7 GB in use).

Which Qwen3.8 9B Distill uncensored heretic quant should you choose?

IQ4_XS (5.2 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.

If memory is tight, the smallest file is the first one in the table at 0.0 GB, with the quality trade-offs that come with fewer bits.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Parameters1M

Source

Quantized bynuofang
FamilyQwen
Downloads (HF)1,655
Last updated2026-08-28

Frequently asked questions about Qwen3.8 9B Distill uncensored heretic

How much VRAM does Qwen3.8 9B Distill uncensored heretic need?

About 6.3 GB at IQ4_XS with an 8K context window. That is the 5.2 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Qwen3.8 9B Distill uncensored heretic on an 8 GB GPU?

Yes, with Q5_K_M: the 6.5 GB file needs about 7.7 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of Qwen3.8 9B Distill uncensored heretic GGUF?

It depends on the quant: file is 0.0 GB, IQ4_XS is 5.2 GB, Q5_K_M is 6.5 GB.

Where can I download Qwen3.8 9B Distill uncensored heretic GGUF?

The files are on Hugging Face in the nuofang/Qwen3.8-9B-Distill-uncensored-heretic-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

Can I run this model on 8 GB VRAM?

Yes, using the IQ4_XS quant which requires 6.3 GB memory at 8 k context. The 5.2 GB file fits within the VRAM limit.

Does the model support vision?

No, the model is a causal language model and does not include vision capabilities.

What context length does it support?

It natively supports 262,144 tokens, inherited from the Qwen3.5 base.

Other GGUFs of Qwen3.8-9B-Distill-uncensored-heretic

Similar models

Browse all →

More from nuofang

All by nuofang →

More Qwen models

All Qwen →

Other tiny models

All tiny models →