Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Models Google Gemma 3 4b It
Gemma · MaziyarPanahi
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma-3-1B-It
Gemma · unsloth
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 4 E4B It
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
Vision
GE
Huihui gemma 4 12B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
Vision
GE
Winnow E4B
Gemma · EldanRing
Params78M
Context128K
Smallest0.2 GB
Vision
GE
Models Google Gemma 2 2b It
Gemma · MaziyarPanahi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 E4B It OBLITERATED v3.1
Gemma · OBLITERATUS
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
Models Google Gemma 3 1b It
Gemma · MaziyarPanahi
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Models Google Gemma 3 12b It
Gemma · MaziyarPanahi
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · ente-ai
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
GE
Models Google Gemma 3 27b It
Gemma · MaziyarPanahi
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma-3-27B-It
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 4b It
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma-4-31B-it
Gemma · ggml-org
Params30.7B
Context256K
Smallest0.3 GB
Vision
GE
Gemma 4 31B
Gemma · lmstudio-community
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
Vision
GE
Gemma 4 12B It
Gemma · bartowski
Params11.9B
Context128K
Q4_K_M7.7 GB
Vision
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · groxaxo
Params25.2B
Context256K
Q4_K_M16.9 GB
Vision
GE
gemma 2b fine tune
Gemma · arnavj007
Params2B
Context—
Smallest0.0 GB
GGUF
GE
Gemma 4 26B A4B It Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 31B It
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Huihui gemma 4 26B A4B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params25.2B
Context128K
Smallest0.9 GB
Vision
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningRoleplay
GE
Gemma 4 26B A4B It Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Coding
GE
Huihui gemma 4 31B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params30.7B
Context128K
Smallest1.0 GB
Vision
GE
gemma 4 26B A4B it qat heretic
Gemma · SC117
Params25.2B
Context256K
Smallest14.2 GB
CodingVision
GE
gemma-2-9b-it
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · lmstudio-community
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision

Keep browsing