GE

Gemma 4 12B StyleTune QAT

GemmaGGUF by alexisStacksCodeUpdated 2026-09-25
Download on Hugging Face
Parameters11.9B
Context256K
Layers4
Architecturegemma4-assistant
Smallest quant0.3 GB
Quick answer

Gemma 4 12B StyleTune QAT needs about 1.8 GB of memory at Q4_0 (a 0.3 GB file) with an 8K context window, so it fits on a 4 GB GPU. This repository has 2 quants, from 0.3 GB (Q4_0) to 7.2 GB (Q4_K_XL). Longer context needs more: at 32K tokens the KV cache alone adds about 4.3 GB.

Gemma 4 12B StyleTune QAT – a 12B model with a new narrative voice

Gemma 4 12B StyleTune QAT is a 11.9 billion‑parameter model that has been fine‑tuned on a single tensor to change its writing style. It retains all reasoning and instruction‑following capabilities of the base Gemma 4 model while delivering a 56 % reduction in clichés. The model supports vision and can be run with llama.cpp.

Good at

  • Narrative style with low clichés
  • Single‑tensor fine‑tuning
  • Maintains full reasoning capability

Limits

  • Requires 8 k context for memory estimates
  • Large VRAM needed for Q4_K_XL
  • No license information provided

Best for

  • Creative writing prompts
  • Story generation
  • Style‑specific content creation

Who it’s for. Developers and content creators who need a Gemma model with a distinct narrative voice without sacrificing general LLM abilities. The model is suitable for applications that require both text and vision inputs.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
Q4_00.3 GB 1.8 GB
Fits Get file →
Q4_K_XL7.2 GB 8.8 GB
Too big Get file →

For systems with limited VRAM, use the Q4_0 quantization (0.25 GB file, ~1.8 GB VRAM at 8 k context). If you have more memory, the Q4_K_XL quant (7.22 GB file, ~8.8 GB VRAM at 8 k context) offers a larger model size with the same style tuning. Both variants keep the same 11.9 billion‑parameter architecture.

What GPU do you need for Gemma 4 12B StyleTune QAT?

These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: the best quant that fits is Q4_0 (0.3 GB file, about 1.8 GB in use).
  • 6 GB VRAM: the best quant that fits is Q4_0 (0.3 GB file, about 1.8 GB in use).
  • 8 GB VRAM: the best quant that fits is Q4_0 (0.3 GB file, about 1.8 GB in use).
  • 12 GB VRAM: the best quant that fits is Q4_K_XL (7.2 GB file, about 8.8 GB in use).

Which Gemma 4 12B StyleTune QAT quant should you choose?

Q4_0 (0.3 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturegemma4-assistant
Parameters11.9B
Layers4
Trained context262,144 tokens
KV cache (fp16)128 KB per token

Source

Quantized byalexisStacksCode
FamilyGemma
Downloads (HF)365
Last updated2026-09-25

Frequently asked questions about Gemma 4 12B StyleTune QAT

How much VRAM does Gemma 4 12B StyleTune QAT need?

About 1.8 GB at Q4_0 with an 8K context window. That is the 0.3 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run Gemma 4 12B StyleTune QAT on an 8 GB GPU?

Yes, with Q4_0: the 0.3 GB file needs about 1.8 GB at 8K context. Larger quants in this repository do not fit in 8 GB.

What is the file size of Gemma 4 12B StyleTune QAT GGUF?

It depends on the quant: Q4_0 is 0.3 GB, Q4_K_XL is 7.2 GB.

What context length does Gemma 4 12B StyleTune QAT support?

The GGUF header lists a trained context length of 262,144 tokens (256K). The KV cache grows with the context you use: about 1.1 GB at 8K and 4.3 GB at 32K.

Where can I download Gemma 4 12B StyleTune QAT GGUF?

The files are on Hugging Face in the alexisStacksCode/Gemma-4-12B-StyleTune-QAT-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

Can I run Gemma 4 12B StyleTune QAT on 4 GB VRAM?

The Q4_0 quantization requires about 1.8 GB VRAM at 8 k context, so 4 GB VRAM is sufficient. The Q4_K_XL quant would exceed that limit.

Does this model support vision?

Yes, the model has detected vision ability and includes the necessary vision projection files.

Is there a license for this model?

No license information is provided in the supplied data.

Other GGUFs of Gemma-4-12B-StyleTune

Similar models

Browse all →

More from alexisStacksCode

All by alexisStacksCode →

More Gemma models

All Gemma →

Other medium models

All medium models →