Export_Glm47_Flash_Abliteratex needs about 33.2 GB of memory at Q8_0 (a 31.8 GB file) with an 8K context window, so it fits on a 48 GB GPU. Longer context needs more: at 32K tokens the KV cache alone adds about 3.4 GB.
GLM-4.7-Flash-Abliteratex, 29.9B MoE model with 202,752 token context
GLM-4.7-Flash-Abliteratex is a 29.9B‑parameter MoE model built on the GLM family and deepseek2 architecture. It supports reasoning and tool use, and is available in a single Q8_0 quantized GGUF file. The model is experimental and can generate unsafe content.
Good at
- Reasoning tasks
- Tool‑based interactions
- Long‑context generation
Limits
- Experimental release; unsafe content possible
- Requires 8.0k context or more
- Single Q8_0 quant only
Best for
- Research on MoE language models
- Local inference with llama.cpp
- Testing low‑refusal behavior
Who it’s for. Developers and researchers who need a large MoE model for local deployment and are comfortable with experimental releases. The model is suitable for those who require reasoning and tool use capabilities and can handle the memory demands of a 31.84 GB GGUF file.
Quants & memory
| Quant | File | Est. memory | vs VRAM | Result | |
|---|---|---|---|---|---|
| Q8_0 | 31.8 GB | 33.2 GB | Too big | Get file → |
The only available quant is Q8_0, with a file size of 31.84 GB and an approximate VRAM requirement of 33.2 GB at 8 k context. For systems with 8 GB VRAM, the model cannot be loaded. If you have 32 GB or more VRAM, Q8_0 is the recommended quant.
What GPU do you need for Export_Glm47_Flash_Abliteratex?
These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.
- 4 GB VRAM: no quant fits at an 8K context.
- 6 GB VRAM: no quant fits at an 8K context.
- 8 GB VRAM: no quant fits at an 8K context.
- 12 GB VRAM: no quant fits at an 8K context.
- 16 GB VRAM: no quant fits at an 8K context.
- 24 GB VRAM: no quant fits at an 8K context.
- 32 GB VRAM: no quant fits at an 8K context.
- 48 GB VRAM: the best quant that fits is Q8_0 (31.8 GB file, about 33.2 GB in use).
Which Export_Glm47_Flash_Abliteratex quant should you choose?
Q8_0 (31.8 GB) is the middle option in this repository. Close to lossless. It costs roughly twice the memory of a 4-bit file, so it suits cases where you have plenty of VRAM.
New to quant names? Read GGUF quantization explained.
Specifications
Architecture from the GGUF header
Source
Frequently asked questions about Export_Glm47_Flash_Abliteratex
How much VRAM does Export_Glm47_Flash_Abliteratex need?
About 33.2 GB at Q8_0 with an 8K context window. That is the 31.8 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.
Can I run Export_Glm47_Flash_Abliteratex on an 8 GB GPU?
Not at an 8K context. The smallest file needs about 33.2 GB, so you would need a larger GPU or CPU offloading.
What is the file size of Export_Glm47_Flash_Abliteratex GGUF?
It depends on the quant: Q8_0 is 31.8 GB.
What context length does Export_Glm47_Flash_Abliteratex support?
The GGUF header lists a trained context length of 202,752 tokens (198K). The KV cache grows with the context you use: about 0.8 GB at 8K and 3.4 GB at 32K.
Where can I download Export_Glm47_Flash_Abliteratex GGUF?
The files are on Hugging Face in the wangzhang/GLM-4.7-Flash-abliteratex repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.
What license does Export_Glm47_Flash_Abliteratex use?
Hugging Face lists the license as mit. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.
Can I run GLM-4.7-Flash-Abliteratex on 8 GB VRAM?
No. The Q8_0 quant requires approximately 33.2 GB VRAM at 8 k context, which exceeds 8 GB.
Is the model safe for production use?
The release is experimental and can produce unsafe or false content; it is not recommended for production.
What context length does the model support?
The model was trained with 202,752 tokens and supports up to that context length.