Qwen Qwen3.8 27B GGUF IQ1 S needs about 0.6 GB of memory at IQ1_S (a 0.1 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.1 GB (IQ1_S) to 9.4 GB (IQ1_S).
Qwen Qwen3.8 27B GGUF IQ1 S – 27B dense vision‑language model
Qwen Qwen3.8 27B GGUF IQ1 S is a 27.3B parameter dense model with native vision‑language support. It is quantized to IQ1_S and available in two file sizes. The model is part of the Qwen family and uses the qwen35 architecture.
Good at
- Vision‑language tasks
- Long‑horizon agentic planning
- Coding and professional work
Limits
- No vision support in some harnesses
- Large memory requirement for full context
- License is other
Best for
- Image‑based code generation
- Multi‑step reasoning with tool calling
- Research prototyping
Who it’s for. Developers and researchers needing a compact vision‑language model for local inference. The model is suitable for environments with limited GPU memory but sufficient RAM for the chosen quant.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| IQ1_S | 0.1 GB | 0.6 GB | Fits | Get file → | |
| IQ1_S | 9.4 GB | 11.0 GB | Too big | Get file → |
For 8‑GB VRAM, use the 0.06‑GB file which estimates 0.6‑GB memory at 8k context. For larger VRAM, the 9.36‑GB file uses about 11‑GB memory at 8k context. Choose the smaller file for low‑resource setups.
What GPU do you need for Qwen Qwen3.8 27B GGUF IQ1 S?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is IQ1_S (0.1 GB file, about 0.6 GB in use).
- 6 GB VRAM: the best quant that fits is IQ1_S (0.1 GB file, about 0.6 GB in use).
- 8 GB VRAM: the best quant that fits is IQ1_S (0.1 GB file, about 0.6 GB in use).
- 12 GB VRAM: the best quant that fits is IQ1_S (9.4 GB file, about 11.0 GB in use).
Which Qwen Qwen3.8 27B GGUF IQ1 S quant should you choose?
IQ1_S (0.1 GB) is the middle option in this repository. Use it only when memory is very tight. Expect a clear drop in quality, which is usually worse on small models and easier to live with on large ones.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Qwen Qwen3.8 27B GGUF IQ1 S
How much VRAM does Qwen Qwen3.8 27B GGUF IQ1 S need?
About 0.6 GB at IQ1_S with an 8K context window. That is the 0.1 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Qwen Qwen3.8 27B GGUF IQ1 S on an 8 GB GPU?
Yes, with IQ1_S: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Qwen Qwen3.8 27B GGUF IQ1 S GGUF?
It depends on the quant: IQ1_S is 0.1 GB, IQ1_S is 9.4 GB.
What context length does Qwen Qwen3.8 27B GGUF IQ1 S support?
The GGUF header lists a trained context length of 262,144 tokens (256K).
Where can I download Qwen Qwen3.8 27B GGUF IQ1 S GGUF?
The files are on Hugging Face in the sigmanih/Qwen-Qwen3.8-27B-GGUF-IQ1_S repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Qwen Qwen3.8 27B GGUF IQ1 S use?
Hugging Face lists the license as other. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, the 0.06‑GB IQ1_S file requires about 0.6‑GB VRAM at 8k context, well within 8 GB.
What is the memory usage at 8k context?
The 0.06‑GB file uses 0.6‑GB memory, while the 9.36‑GB file uses 11‑GB memory at 8k context.
Does this model support vision tasks?
Yes, it is a native vision‑language model that understands images and videos.