Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Models Google Gemma 3 4b It
Gemma · MaziyarPanahi
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma-3-1B-It
Gemma · unsloth
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 4 E4B It
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
GE
Huihui gemma 4 12B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
GE
Winnow E4B
Gemma · EldanRing
Params78M
Context128K
Smallest0.2 GB
GE
Models Google Gemma 2 2b It
Gemma · MaziyarPanahi
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 E4B It OBLITERATED v3.1
Gemma · OBLITERATUS
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Models Google Gemma 3 1b It
Gemma · MaziyarPanahi
Params1B
Context32K
Q4_K_M0.8 GB
GE
Models Google Gemma 3 12b It
Gemma · MaziyarPanahi
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma-4-E2B-It
Gemma · ente-ai
Params4.65B
Context128K
Q4_K_M3.1 GB
GE
Models Google Gemma 3 27b It
Gemma · MaziyarPanahi
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma-3-27B-It
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 4b It
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma-4-31B-it
Gemma · ggml-org
Params30.7B
Context256K
Smallest0.3 GB
GE
Gemma 4 31B
Gemma · lmstudio-community
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
GE
Gemma 4 12B It
Gemma · bartowski
Params11.9B
Context128K
Q4_K_M7.7 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · groxaxo
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
gemma 2b fine tune
Gemma · arnavj007
Params2B
Context—
Smallest0.0 GB
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B It
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Huihui gemma 4 26B A4B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params25.2B
Context128K
Smallest0.9 GB
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Huihui gemma 4 31B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params30.7B
Context128K
Smallest1.0 GB
GE
gemma 4 26B A4B it qat heretic
Gemma · SC117
Params25.2B
Context256K
Smallest14.2 GB
GE
gemma-2-9b-it
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It
Gemma · lmstudio-community
Params11.8B
Context128K
Q4_K_M7.3 GB