qwen27B Agent R2 abliterated preview needs about 18.7 GB of memory at IQ4_NL (a 16.0 GB file) with an 8K context window, so it fits on a 24 GB GPU. This repository has 5 quants, from 8.5 GB to 54.7 GB (F16). Longer context needs more: at 32K tokens the KV cache alone adds about 8.7 GB.
27B Agent Model with tool‑calling, MTP, and abliterated guardrails
qwen27B Agent R2 abliterated preview is a 27.3B‑parameter model built on Qwen3.6‑27B. It supports reasoning, tool‑calling, and vision via a paired projector. The model is released under agpl‑3.0 and includes Multi‑Token Prediction for speculative decoding.
Good at
- Tool‑calling and agent planning
- Multi‑step reasoning
- Vision tasks with mmproj
Limits
- No built‑in vision support without mmproj
- Requires 8‑token context for full MTP functionality
- License is agpl‑3.0
Best for
- Single‑user agent workloads
- Python and shell script generation
- Multimodal image understanding with mmproj
Who it’s for. Developers needing an agent‑ready LLM with speculative decoding and tool‑calling. Researchers working on multimodal tasks who can pair the model with a vision projector. Users comfortable with agpl‑3.0 licensing and willing to manage memory constraints.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| — | 8.5 GB | 11.2 GB | Too big | Get file → | |
| Q2_K | 10.9 GB | 13.5 GB | Too big | Get file → | |
| IQ4_NL | 16.0 GB | 18.7 GB | Too big | Get file → | |
| Q6_K | 22.4 GB | 25.1 GB | Too big | Get file → | |
| F16 | 54.7 GB | 57.3 GB | Too big | Get file → |
For 8‑GB VRAM, the Q2_K quant (~13.5 GB memory at 8k context) is the smallest available. If you have 16‑GB VRAM, Q6_K (~25.1 GB memory at 8k context) offers higher quality. The F16 quant (~57.3 GB memory) is only suitable for large‑memory systems.
What GPU do you need for qwen27B Agent R2 abliterated preview?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: the best quant that fits is the main file (8.5 GB file, about 11.2 GB in use).
- 16 GB VRAM: the best quant that fits is Q2_K (10.9 GB file, about 13.5 GB in use).
- 24 GB VRAM: the best quant that fits is IQ4_NL (16.0 GB file, about 18.7 GB in use).
- 32 GB VRAM: the best quant that fits is Q6_K (22.4 GB file, about 25.1 GB in use).
- 48 GB VRAM: the best quant that fits is Q6_K (22.4 GB file, about 25.1 GB in use).
Which qwen27B Agent R2 abliterated preview quant should you choose?
IQ4_NL (16.0 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.
If memory is tight, the smallest file is the first one in the table at 8.5 GB, with the quality trade-offs that come with fewer bits.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about qwen27B Agent R2 abliterated preview
How much VRAM does qwen27B Agent R2 abliterated preview need?
About 18.7 GB at IQ4_NL with an 8K context window. That is the 16.0 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run qwen27B Agent R2 abliterated preview on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 11.2 GB, so you would need a larger GPU or CPU offloading.
What is the file size of qwen27B Agent R2 abliterated preview GGUF?
It depends on the quant: file is 8.5 GB, Q2_K is 10.9 GB, IQ4_NL is 16.0 GB, Q6_K is 22.4 GB, F16 is 54.7 GB.
What context length does qwen27B Agent R2 abliterated preview support?
The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 2.2 GB at 8K and 8.7 GB at 32K.
Where can I download qwen27B Agent R2 abliterated preview GGUF?
The files are on Hugging Face in the hotdogs/qwen27B-Agent-R2-abliterated-preview repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does qwen27B Agent R2 abliterated preview use?
Hugging Face lists the license as agpl-3.0. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run this model on 8 GB VRAM?
The smallest quant, Q2_K, requires about 13.5 GB memory at 8k context, so 8 GB VRAM is insufficient.
Does this model support vision out of the box?
No. Vision support requires pairing with the mmproj projector from Qwen/Qwen3.6‑27B.
What license applies to this model?
The model is released under agpl‑3.0, which requires source disclosure for derivative works.