GE

gemma 3 12b it ultra uncensored heretic

GemmaGGUF by llmfan46Updated 2026-03-27
Download on Hugging Face
Parameters11.8B
Context128K
Layers48
Architecturegemma3
Smallest quant4.8 GB
Quick answer

gemma 3 12b it ultra uncensored heretic needs about 10.3 GB of memory at IQ4_XS (a 6.6 GB file) with an 8K context window, so it fits on a 12 GB GPU. This repository has 10 quants, from 4.8 GB (IQ3_XXS) to 12.5 GB (Q8_0). Longer context needs more: at 32K tokens the KV cache alone adds about 12.9 GB.

Gemma 3 12B IT Ultra Uncensored Heretic – a multimodal, 128K context, 11.8B‑parameter model

Gemma 3 12B IT Ultra Uncensored Heretic is a 11.8B‑parameter multimodal model with a 131072‑token context window. It supports text and image input and produces text output. The model is available in multiple GGUF quantizations.

Good at

  • Multimodal text and image understanding
  • Large context handling
  • Instruction‑tuned responses

Limits

  • No vision support without a projector file
  • Large memory requirement for higher‑quality quants
  • License is gemma – check usage terms

Best for

  • Chatbots needing long context
  • Image captioning with text prompts
  • Fine‑tuning for specialized tasks

Who it’s for. Developers building lightweight multimodal applications on limited hardware. Researchers needing a large‑context model with open weights.

Quants & memory

QuantFileEst. memoryvs VRAMResultDownload
IQ3_XXS4.8 GB 8.5 GB
Too big Get file →
IQ3_XS5.2 GB 8.9 GB
Too big Get file →
IQ3_S5.5 GB 9.2 GB
Too big Get file →
IQ3_M5.7 GB 9.4 GB
Too big Get file →
IQ4_XS6.6 GB 10.3 GB
Too big Get file →
IQ4_NL6.9 GB 10.6 GB
Too big Get file →
Q5_K_S8.2 GB 12.0 GB
Too big Get file →
Q5_K_M8.4 GB 12.2 GB
Too big Get file →
Q6_K9.7 GB 13.4 GB
Too big Get file →
Q8_012.5 GB 16.2 GB
Too big Get file →

For 8 GB VRAM, use IQ3_XXS (4.78 GB, 8.5 GB memory at 8 k context) or IQ3_XS (5.21 GB, 8.9 GB). For 12 GB VRAM, IQ4_XS (6.55 GB, 10.3 GB) or Q5_K_S (8.23 GB, 12 GB) are suitable. Higher quants need more VRAM.

What GPU do you need for gemma 3 12b it ultra uncensored heretic?

These figures add the file size, an fp16 KV cache at an 8K context window (worked out from this model’s own header) and about 0.5 GB for the runtime. They are estimates, so leave a little headroom, and expect to use less context or a smaller quant if you are right at the limit.

  • 4 GB VRAM: no quant fits at an 8K context.
  • 6 GB VRAM: no quant fits at an 8K context.
  • 8 GB VRAM: no quant fits at an 8K context.
  • 12 GB VRAM: the best quant that fits is Q5_K_S (8.2 GB file, about 12.0 GB in use).
  • 16 GB VRAM: the best quant that fits is Q6_K (9.7 GB file, about 13.4 GB in use).
  • 24 GB VRAM: the best quant that fits is Q8_0 (12.5 GB file, about 16.2 GB in use).

Which gemma 3 12b it ultra uncensored heretic quant should you choose?

IQ4_XS (6.6 GB) is the middle option in this repository. The usual sweet spot between file size and quality, and the quant most people start with.

If memory is tight, the smallest file is IQ3_XXS at 4.8 GB, with the quality trade-offs that come with fewer bits. A reasonable choice when a 4-bit file will not fit, mostly on larger models. Quality loss is noticeable but often acceptable.

New to quant names? Read GGUF quantization explained.

Specifications

Architecture from the GGUF header

Architecturegemma3
Parameters11.8B
Layers48
Trained context131,072 tokens
KV cache (fp16)384 KB per token

Source

Quantized byllmfan46
FamilyGemma
Licensegemma
Downloads (HF)2,676
Last updated2026-03-27

Frequently asked questions about gemma 3 12b it ultra uncensored heretic

How much VRAM does gemma 3 12b it ultra uncensored heretic need?

About 10.3 GB at IQ4_XS with an 8K context window. That is the 6.6 GB file, plus the KV cache and roughly 0.5 GB of runtime overhead. Smaller quants need less and longer context needs more.

Can I run gemma 3 12b it ultra uncensored heretic on an 8 GB GPU?

Not at an 8K context. The smallest file needs about 8.5 GB, so you would need a larger GPU or CPU offloading.

What is the file size of gemma 3 12b it ultra uncensored heretic GGUF?

It depends on the quant: IQ3_XXS is 4.8 GB, IQ3_XS is 5.2 GB, IQ3_S is 5.5 GB, IQ3_M is 5.7 GB, IQ4_XS is 6.6 GB, IQ4_NL is 6.9 GB and 4 more.

What context length does gemma 3 12b it ultra uncensored heretic support?

The GGUF header lists a trained context length of 131,072 tokens (128K). The KV cache grows with the context you use: about 3.2 GB at 8K and 12.9 GB at 32K.

Where can I download gemma 3 12b it ultra uncensored heretic GGUF?

The files are on Hugging Face in the llmfan46/gemma-3-12b-it-ultra-uncensored-heretic-GGUF repository. The download buttons on this page open the file on Hugging Face. ggufmodels.com does not host any model files.

What license does gemma 3 12b it ultra uncensored heretic use?

Hugging Face lists the license as gemma. Licenses can differ between the quantized files and the original model, so check the repository and the base model before commercial use.

Can I run this model on 8 GB VRAM?

Yes, with IQ3_XXS or IQ3_XS quantizations, which use 8.5–8.9 GB memory at 8 k context.

Do I need a vision projector file?

Yes, vision/multimodal capabilities require a separate projector file.

What is the context length of this model?

The model supports 131072 tokens of context.

Other GGUFs of gemma-3-12b-it-ultra-uncensored-heretic

Similar models

Browse all →

More from llmfan46

All by llmfan46 →

More Gemma models

All Gemma →

Other medium models

All medium models →