QW

Qwen Qwen3.8 27B GGUF IQ1 S

QwenGGUF by sigmanihUpdated 2026-10-30
Download on Hugging Face
Parameters27.3B
Context256K
Layers—
Architectureqwen35
Smallest quant0.1 GB
Quick answer

Qwen Qwen3.8 27B GGUF IQ1 S needs about 0.6 GB of memory at IQ1_S (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.1 GB (IQ1_S) to 9.4 GB (IQ1_S).

Qwen Qwen3.8 27B GGUF IQ1 S – 27B dense vision‑language model

Qwen Qwen3.8 27B GGUF IQ1 S is a 27.3B parameter dense model with native vision‑language support. It is quantized to IQ1_S and available in two file sizes. The model is part of the Qwen family and uses the qwen35 architecture.

Good at

  • Vision‑language tasks
  • Long‑horizon agentic planning
  • Coding and professional work

Limits

  • No vision support in some harnesses
  • Large memory requirement for full context
  • License is other

Best for

  • Image‑based code generation
  • Multi‑step reasoning with tool calling
  • Research prototyping

Who it’s for. Developers and researchers needing a compact vision‑language model for local inference. The model is suitable for environments with limited GPU memory but sufficient RAM for the chosen quant.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
IQ1_S0.1 GB 0.6 GB
Fits Get file →
IQ1_S9.4 GB 11.0 GB
Too big Get file →

For 8‑GB VRAM, use the 0.06‑GB file which estimates 0.6‑GB memory at 8k context. For larger VRAM, the 9.36‑GB file uses about 11‑GB memory at 8k context. Choose the smaller file for low‑resource setups.

What GPU do you need for Qwen Qwen3.8 27B GGUF IQ1 S?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is IQ1_S (0.1 GB file, about 0.6 GB in use).
  • 6 GB VRAM: the best quant that fits is IQ1_S (0.1 GB file, about 0.6 GB in use).
  • 8 GB VRAM: the best quant that fits is IQ1_S (0.1 GB file, about 0.6 GB in use).
  • 12 GB VRAM: the best quant that fits is IQ1_S (9.4 GB file, about 11.0 GB in use).

Which Qwen Qwen3.8 27B GGUF IQ1 S quant should you choose?

IQ1_S (0.1 GB) is the middle option in this repository. Use it only when memory is very tight. Expect a clear drop in quality, which is usually worse on small models and easier to live with on large ones.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architectureqwen35
Parameters27.3B
Trained context262,144 tokens

Source

Quantized bysigmanih
FamilyQwen
Licenseother
Downloads (HF)1,760
Last updated2026-10-30

Frequently asked questions about Qwen Qwen3.8 27B GGUF IQ1 S

How much VRAM does Qwen Qwen3.8 27B GGUF IQ1 S need?

About 0.6 GB at IQ1_S with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Qwen Qwen3.8 27B GGUF IQ1 S on an 8 GB GPU?

Yes, with IQ1_S: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of Qwen Qwen3.8 27B GGUF IQ1 S GGUF?

It depends on the quant: IQ1_S is 0.1 GB, IQ1_S is 9.4 GB.

What context length does Qwen Qwen3.8 27B GGUF IQ1 S support?

The GGUF header lists a trained context length of 262,144 tokens (256K).

Where can I download Qwen Qwen3.8 27B GGUF IQ1 S GGUF?

The files are on Hugging Face in the sigmanih/Qwen-Qwen3.8-27B-GGUF-IQ1_S repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does Qwen Qwen3.8 27B GGUF IQ1 S use?

Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, the 0.06‑GB IQ1_S file requires about 0.6‑GB VRAM at 8k context, well within 8 GB.

What is the memory usage at 8k context?

The 0.06‑GB file uses 0.6‑GB memory, while the 9.36‑GB file uses 11‑GB memory at 8k context.

Does this model support vision tasks?

Yes, it is a native vision‑language model that understands images and videos.

Other GGUFs of Qwen3.8-27B

Similar models

Browse all →

More from sigmanih

All by sigmanih →

More Qwen models

All Qwen →

Other medium models

All medium models →