Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
GE
t5gemma-b-b-ul2 tokenizer (Gemma BPE)
Gemma · thepatch
Params282M
Context—
Smallest0.0 GB
GGUF
GE
gemma 4 26B A4B it qat uncensored heretic UDmerge
Gemma · EZForever
Params25.2B
Context256K
Smallest14.2 GB
Vision
GE
Gemma-3-270M-It-Qat
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Tiger Gemma 12B v3
Gemma · bartowski
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
GE
Gemma 4 26B A4B
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Vikhr-Gemma-2B-instruct
Gemma · Vikhrmodels
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 31B StyleTune
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
GE
Gemma 3 27b It
Gemma · ggml-org
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemma 4 26B A4B It Heretic
Gemma · nohurry
Params25.2B
Context256K
Q4_K_M16.9 GB
CodingVision
GE
Gemma 4 E2B
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma 4 31B Abliterated Uncensored
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Gemma 4 26b A4B Heretic Styletune v2 Head
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GGUF
GE
Gemma 4 12B Unified System One
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
gemma-2-9b-it
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GGUF
GE
Gemma 4 12B It Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Mahou-1.3-gemma2-9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E2B It Uncensored MAX
Gemma · prithivMLmods
Params4.65B
Context128K
Smallest5.0 GB
ReasoningVision
GE
DiarizationLM Gemma 4 E4B v1
Gemma · diarizers-community
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma 4 26B A4B It Abliterated
Gemma · SevenOfNine
Params25.2B
Context256K
Smallest19.1 GB
Vision
GE
Huihui Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
GE
Gemma 4 Dark Thoughts V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Gemma 4 Queen 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
Gemma-4-E4B-It
Gemma · ente-ai
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Skaldic Gemma 4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma 4 E4B It Apostate
Gemma · mradermacher
Params8.13B
Context128K
Q4_K_M5.0 GB
ReasoningTool use

Keep browsing