Qwen3.8 Whittle MoE 27B A17.8B needs about 0.5 GB of memory at its main file (a 0.0 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.0 GB to 23.1 GB (Q6_K).
Qwen3.8 Whittle MoE 27B A17.8B – 27B parameter dense vision-language model
Qwen3.8 Whittle MoE 27B A17.8B is a 27B parameter dense model built on Qwen3.8. It supports vision-language tasks and includes native image and video understanding. The model is released under the apache-2.0 license.
Good at
- Vision‑language understanding
- Long‑horizon agentic tasks
- Coding and professional work
Limits
- Requires large memory – 26.4 GB at 8 k context for Q6_K
- Only the listed quantisations are available
- No other vision or audio extensions documented
Best for
- Deploying on GPU with 8 GB VRAM using the small quant
- Running inference on 32 GB VRAM with Q6_K
- Integrating into existing LLM pipelines via llama.cpp
Who it’s for. Engineers and researchers who need a dense 27B vision‑language model for complex, multi‑step tasks. The model is suitable for developers looking to embed advanced reasoning and image/video processing into applications.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 0.0 GB | 0.5 GB | Fits | Get file → | |
| Q6_K | 23.1 GB | 26.4 GB | Too big | Get file → |
For systems with 8 GB VRAM, use the "unknown" quant file (0.01 GB, ~0.5 GB memory at 8 k context). For larger GPUs, the Q6_K quant (23.14 GB, ~26.4 GB memory) is recommended. Memory estimates are approximate.
What GPU do you need for Qwen3.8 Whittle MoE 27B A17.8B?
These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 6 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 8 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 12 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 16 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 24 GB VRAM: the best quant that fits is the main file (0.0 GB file, about 0.5 GB in use).
- 32 GB VRAM: the best quant that fits is Q6_K (23.1 GB file, about 26.4 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Qwen3.8 Whittle MoE 27B A17.8B
How much VRAM does Qwen3.8 Whittle MoE 27B A17.8B need?
About 0.5 GB at its main file with an 8K context window. That is the 0.0 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Qwen3.8 Whittle MoE 27B A17.8B on an 8 GB GPU?
Yes, with the smaller files: the 0.0 GB file needs about 0.5 GB at 8K context. Larger quants in this repository do not fit in 8 GB.
What is the file size of Qwen3.8 Whittle MoE 27B A17.8B GGUF?
It depends on the quant: file is 0.0 GB, Q6_K is 23.1 GB.
Where can I download Qwen3.8 Whittle MoE 27B A17.8B GGUF?
The files are on Hugging Face in the Atomic-Germ/Qwen3.8-Whittle-MoE-27B-A17.8B-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Qwen3.8 Whittle MoE 27B A17.8B use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
Yes, by using the "unknown" quant file which requires about 0.5 GB memory at 8 k context.
What quantisation is best for a 32 GB GPU?
The Q6_K quantisation is suitable, using roughly 26.4 GB memory at 8 k context.
Is this model licensed for commercial use?
It is released under the apache-2.0 license, which permits commercial use.