QW

Qwen3.5 9B distilled coding agentic

QwenGGUF by blackshell69Updated 2026-08-20
Download on Hugging Face
Parameters9.2B
Context256K
Layers—
Architectureqwen35
Smallest quant0.1 GB
Quick answer

Qwen3.5 9B distilled coding agentic needs about 0.6 GB of memory at F16 (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.1 GB (F16) to 5.6 GB (IQ4_NL).

Qwen3.5 9B distilled coding agentic – lightweight coding and tool‑use model

Qwen3.5 9B distilled coding agentic is a 9.2B parameter model derived from Qwen3.5‑9B. It is trained with QLoRA and LoRA adapters to enhance coding and agentic tool‑use. The model supports a native context length of 262,144 tokens.

Good at

  • Coding tasks
  • Agentic tool‑use
  • Instruction following

Limits

  • No vision support
  • Requires 8,000‑token context for memory estimates
  • Apache‑2.0 license

Best for

  • Local coding assistants
  • Tool‑calling agents
  • Educational coding demos

Who it’s for. Developers needing a small, efficient model for coding and agentic applications. The model runs on consumer GPUs and is suitable for local deployment with llama.cpp.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
F160.1 GB 0.6 GB
Fits Get file →
IQ4_NL5.6 GB 6.8 GB
Fits Get file →

For 8 GB VRAM, use the IQ4_NL quantized file (5.58 GB, ~6.8 GB memory at 8 k context). For higher VRAM, the F16 file (0.12 GB, ~0.6 GB memory) offers the best performance. Memory estimates are approximate.

What GPU do you need for Qwen3.5 9B distilled coding agentic?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is F16 (0.1 GB file, about 0.6 GB in use).
  • 6 GB VRAM: the best quant that fits is F16 (0.1 GB file, about 0.6 GB in use).
  • 8 GB VRAM: the best quant that fits is IQ4_NL (5.6 GB file, about 6.8 GB in use).

Which Qwen3.5 9B distilled coding agentic quant should you choose?

F16 (0.1 GB) is the middle option in this repository. The unquantized model. It gives original quality and needs the most memory, so it is mainly for conversion or reference.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureqwen35
Parameters9.2B
Trained context262,144 tokens

Source

Quantized byblackshell69
FamilyQwen
Base modelQwen/Qwen3.5-9B
Licenseapache-2.0
Downloads (HF)719
Last updated2026-08-20

Frequently asked questions about Qwen3.5 9B distilled coding agentic

How much VRAM does Qwen3.5 9B distilled coding agentic need?

About 0.6 GB at F16 with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Qwen3.5 9B distilled coding agentic on an 8 GB GPU?

Yes, with IQ4_NL: the 5.6 GB file needs about 6.8 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of Qwen3.5 9B distilled coding agentic GGUF?

It depends on the quant: F16 is 0.1 GB, IQ4_NL is 5.6 GB.

What context length does Qwen3.5 9B distilled coding agentic support?

The GGUF header lists a trained context length of 262,144 tokens (256K).

Where can I download Qwen3.5 9B distilled coding agentic GGUF?

The files are on Hugging Face in the blackshell69/Qwen3.5-9B-distilled-coding-agentic repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Qwen3.5 9B distilled coding agentic use?

Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, using the IQ4_NL quantized file which requires about 6.8 GB memory at 8 k context.

Does this model support vision?

No, it is a language‑only model.

What license does it use?

Apache‑2.0.

Other GGUFs of Qwen3.5-9B

Similar models

Browse all →

More from blackshell69

All by blackshell69 →

More Qwen models

All Qwen →

Other small models

All small models →