Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma 4 Giftige Blume 31B v1
Gemma · Blazed-Forge
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
GE
MR_MARTIN_31b_V1.0_Gemma 4 Base Ftp
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
ReasoningRoleplayTool use
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-26B-A4B-It
Gemma · noctrex
Params25.2B
Context256K
Smallest15.4 GB
Vision
GE
gemma 3n E4B it
Gemma · ggml-org
Params6.9B
Context32K
Smallest7.4 GB
GGUF
GE
gemma 4 E2B it heretic
Gemma · saidutta69
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma 4 26B A4B It Claude Opus Distill
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Amory0201
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma 3 12b It Vl GLM 4.7 Flash Polaris Thinking Heretic Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
Gemma 4 Gembrain X 31B
Gemma · Nimbz
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
GE
Gemma 4 12B It Esper4
Gemma · bartowski
Params11.9B
Context256K
Q4_K_M7.7 GB
CodingReasoningVision
GE
Gemma 3 4b It Uncensored
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 E4B IT ABLITERATED UNCENSORED PHILADELPHIA CLASS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma 4 E4B It The DECKARD Claude Opus Expresso Universe HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingReasoningRoleplay
GE
gemma 2 2b rebus solver fp16
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Huihui Gemma 4 12B It Abliterated
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
GE
gemma 4 E4B it qat q4 0 heretic
Gemma · FadedRedStar
Params7.46B
Context128K
Smallest0.1 GB
CodingVision
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma 2 2b
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
GE
gemma 3 4b instruct
Gemma · lm-kit
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Amoral Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
voxprint gemma4 31b
Gemma · Mitroshenkov87
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma-4-26B-A4B-It
Gemma · TaterTotterson
Params25.2B
Context256K
Q4_K_M16.9 GB
Vision
GE
Gemma4 31b Opus Reasoning v5
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision
GE
TheDrummer Gemmasutra Small 4B v1
Gemma · bartowski
Params3.86B
Context8K
Q4_K_M2.5 GB
GGUF

Keep browsing