Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma4 Gutenberg 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GE
Gemma-3-12B-It-Qat-Int4
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 2 27b it abliterated
Gemma · QuantFactory
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
GemmaTheWriter
Gemma · DavidAU
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · ScottzillaSystems
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 1b It Qat
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GE
medgap gemma 4 12b
Gemma · protocolsyncllc
Params11.9B
Context256K
Smallest0.5 GB
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · CrucibleLab
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
gemma 4 31B it qat uncensored heretic UDmerge
Gemma · EZForever
Params30.7B
Context256K
Smallest17.3 GB
GE
gemma 4 E4B it heretic
Gemma · igorls
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 4B it Uncensored
Gemma · lemuralabs
Params3.88B
Context128K
Smallest1.2 GB
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params11.8B
Context128K
Smallest7.1 GB
GE
Gemma 4 26B A4B It Heretic Ara v2
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Tiger Gemma 12B v3
Gemma · TheDrummer
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 4 12B it AEON Abliterated K4
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma SEA LION v4 4B VL
Gemma · aisingapore
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 E4B It Uncensored
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
gemma-3-27b-it-codeforces-SFT
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 4 19B A4B It The DECKARD Heretic Uncensored Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
GE
Gemma 4 12B It Qat Q4_0 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Smallest7.6 GB
GE
Gemma 4 31B It SDFT Heretic RP
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GE
gemma-4-31B-it-uncensored-biproj
Gemma · ressl
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B it abliterated
Gemma · LiconStudio
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 1b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params1B
Context32K
Smallest0.7 GB