Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 Giftige Blume 31B v1
Gemma · Blazed-Forge
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
MR_MARTIN_31b_V1.0_Gemma 4 Base Ftp
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-4-26B-A4B-It
Gemma · noctrex
Params25.2B
Context256K
Smallest15.4 GB
GE
gemma 3n E4B it
Gemma · ggml-org
Params6.9B
Context32K
Smallest7.4 GB
GE
gemma 4 E2B it heretic
Gemma · saidutta69
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 26B A4B It Claude Opus Distill
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Amory0201
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 12b It Vl GLM 4.7 Flash Polaris Thinking Heretic Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 Gembrain X 31B
Gemma · Nimbz
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 12B It Esper4
Gemma · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
GE
Gemma 3 4b It Uncensored
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 E4B IT ABLITERATED UNCENSORED PHILADELPHIA CLASS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E4B It The DECKARD Claude Opus Expresso Universe HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
gemma 2 2b rebus solver fp16
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
gemma 4 E4B it qat q4 0 heretic
Gemma · FadedRedStar
Params7.46B
Context128K
Smallest0.1 GB
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 2 2b
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GE
gemma 3 4b instruct
Gemma · lm-kit
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Amoral Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
voxprint gemma4 31b
Gemma · Mitroshenkov87
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma-4-26B-A4B-It
Gemma · TaterTotterson
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
Gemma4 31b Opus Reasoning v5
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
TheDrummer Gemmasutra Small 4B v1
Gemma · bartowski
Params3.86B
Context8K
Q4_K_M2.5 GB