Qwen3.8 27B NVFP4 BUDGET needs about 17.2 GB of memory at its main file (a 14.6 GB file) with an 8K context window, so it fits on a 24 GB GPU. This repository has 2 quants, from 14.6 GB to 14.7 GB. Longer context needs more: at 32K tokens the KV cache alone adds about 8.6 GB.
Qwen3.8-27B NVFP4 BUDGET – compact vision‑language model
Qwen3.8-27B NVFP4 BUDGET is a 27B parameter dense model with native vision support and a 262,144‑token context. It is quantized to NVFP4 for reduced memory footprint and is available in two GGUF files of 14.59 GB and 14.72 GB. The model is licensed under Apache‑2.0.
Good at
- Vision‑language understanding
- Long‑horizon agentic tasks
- Coding and professional work
Limits
- Requires 17.2–17.4 GB VRAM at 8k context
- No speculative decoding head
- No MTP support
Best for
- Deploying on 16 GB VRAM GPUs
- Running on single‑GPU inference setups
- Fine‑tuning with Unsloth Desktop
Who it’s for. Developers and researchers needing a compact vision‑language model for single‑GPU deployment. The model is suitable for applications that require image and video understanding without the need for speculative decoding or large memory budgets.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 14.6 GB | 17.2 GB | Too big | Get file → | |
| — | 14.7 GB | 17.4 GB | Too big | Get file → |
The two provided GGUF files are the smallest NVFP4 variants. Each file is 14.59 GB or 14.72 GB and requires approximately 17.2 GB or 17.4 GB of VRAM at an 8k context length. For a 16 GB VRAM GPU, these variants are slightly above the limit; consider using a non‑NVFP4 GGUF from the original unsloth repository if strict 16 GB compliance is needed.
What GPU do you need for Qwen3.8 27B NVFP4 BUDGET?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: the best quant that fits is the main file (14.7 GB file, about 17.4 GB in use).
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Qwen3.8 27B NVFP4 BUDGET
How much VRAM does Qwen3.8 27B NVFP4 BUDGET need?
About 17.2 GB at its main file with an 8K context window. That is the 14.6 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Qwen3.8 27B NVFP4 BUDGET on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 17.2 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Qwen3.8 27B NVFP4 BUDGET GGUF?
It depends on the quant: file is 14.6 GB, file is 14.7 GB.
What context length does Qwen3.8 27B NVFP4 BUDGET support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 2.1 GB at 8K and 8.6 GB at 32K.
Where can I download Qwen3.8 27B NVFP4 BUDGET GGUF?
The files are on Hugging Face in the esatapedico/Qwen3.8-27B-NVFP4-BUDGET-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Qwen3.8 27B NVFP4 BUDGET use?
Hugging Face lists the license as apache-2.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run Qwen3.8-27B NVFP4 BUDGET on a 16 GB VRAM GPU?
The model requires about 17.2–17.4 GB of VRAM at 8k context, so it exceeds a 16 GB limit. Use a larger GPU or a non‑NVFP4 variant.
Does this model support vision tasks?
Yes, it is a native vision‑language model that understands images and videos.
What license does the model use?
The model is released under the Apache‑2.0 license.