GL

GLM 4.7 Flash abliterated 12GB

GLMGGUF by cognitiversUpdated 2026-08-25
Download on Hugging Face
Parameters29.9B
Context198K
Layers—
Architecturedeepseek2
Smallest quant0.1 GB
Quick answer

GLM 4.7 Flash abliterated 12GB needs about 13.2 GB of memory at IQ2_M (a 11.3 GB file) with an 8K context window, so it fits on a 16 GB GPU. This repository has 3 quants, from 0.1 GB to 18.2 GB (Q4_K).

GLM 4.7 Flash abliterated 12GB – a 29.94B MoE model for 12 GB GPUs

GLM 4.7 Flash abliterated 12GB is a 29.94B parameter Mixture‑of‑Experts model. It is designed for a 12 GB consumer GPU with routed experts offloaded to system RAM. The model is released under the MIT license.

Good at

  • Large‑context generation
  • Research‑grade language modeling
  • Customizable MoE inference

Limits

  • Requires 12 GB VRAM or more
  • No vision support
  • Reduced safety filtering – use with caution

Best for

  • Academic research on MoE models
  • Controlled environment testing
  • GPU‑bound inference pipelines

Who it’s for. Researchers and developers who need a large MoE model that fits on a 12 GB GPU. The model is suitable for experimental use and should not be deployed in production or public settings without additional safety measures.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
—0.1 GB 0.6 GB
Fits Get file →
IQ2_M11.3 GB 13.2 GB
Too big Get file →
Q4_K18.2 GB 20.9 GB
Too big Get file →

The 0.07 GB quant has an estimated 0.6 GB memory at 8 k context, suitable for very low‑budget setups. The IQ2_M quant (11.3 GB) uses about 13.2 GB memory at 8 k context, fitting on a 12 GB GPU with some RAM offloading. The Q4_K quant (18.18 GB) requires about 20.9 GB memory at 8 k context and is best for larger GPUs.

What GPU do you need for GLM 4.7 Flash abliterated 12GB?

These figures add the file size, an fp16 KV cache at an 8K context window and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
  • 6 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
  • 8 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
  • 12 GB VRAM: the best quant that fits is the main file (0.1 GB file, about 0.6 GB in use).
  • 16 GB VRAM: the best quant that fits is IQ2_M (11.3 GB file, about 13.2 GB in use).
  • 24 GB VRAM: the best quant that fits is Q4_K (18.2 GB file, about 20.9 GB in use).

Which GLM 4.7 Flash abliterated 12GB quant should you choose?

IQ2_M (11.3 GB) is the middle option in this repository. Use it only when memory is very tight. Expect a clear drop in quality, which is usually worse on small models and easier to live with on large ones.

If memory is tight, the smallest file is the first one in the table at 0.1 GB, with the quality trade-offs that come with fewer bits.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturedeepseek2
Parameters29.9B
Trained context202,752 tokens

Source

Quantized bycognitivers
FamilyGLM
Licensemit
Downloads (HF)1,068
Last updated2026-08-25

Frequently asked questions about GLM 4.7 Flash abliterated 12GB

How much VRAM does GLM 4.7 Flash abliterated 12GB need?

About 13.2 GB at IQ2_M with an 8K context window. That is the 11.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run GLM 4.7 Flash abliterated 12GB on an 8 GB GPU?

Yes, with the smaller files: the 0.1 GB file needs about 0.6 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of GLM 4.7 Flash abliterated 12GB GGUF?

It depends on the quant: file is 0.1 GB, IQ2_M is 11.3 GB, Q4_K is 18.2 GB.

What context length does GLM 4.7 Flash abliterated 12GB support?

The GGUF header lists a trained context length of 202,752 tokens (198K).

Where can I download GLM 4.7 Flash abliterated 12GB GGUF?

The files are on Hugging Face in the cognitivers/GLM-4.7-Flash-abliterated-12GB-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does GLM 4.7 Flash abliterated 12GB use?

Hugging Face lists the license as mit. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on a 12 GB GPU?

Yes, the model is designed for a 12 GB consumer GPU with routed experts offloaded to system RAM.

What memory does the IQ2_M quant need?

It estimates 13.2 GB memory at 8 k context, so it fits on a 12 GB GPU with some RAM offloading.

Is this model safe for public use?

No. The safety filtering is significantly reduced; it is intended for research and controlled environments only.

Other GGUFs of Huihui-GLM-4.7-Flash-abliterated

Similar models

Browse all →

More from cognitivers

All by cognitivers →

More GLM models

All GLM →

Other medium models

All medium models →