Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
gemma 3 12b it ultra uncensored heretic
Gemma · llmfan46
Params11.8B
Context128K
Smallest4.8 GB
Vision
GE
Gemma 4 26B A4B It Assistant
Gemma · AtomicChat
Params420M
Context256K
Q4_K_M0.3 GB
GGUF
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
Vision
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 31B it Mystery Fine Tune HERETIC UNCENSORED Thinking Instruct
Gemma · DavidAU
Params30.7B
Context256K
Smallest17.8 GB
CodingReasoningRoleplay
GE
Gemma 3 4b It Abliterated
Gemma · mlabonne
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 E4B It OBLITERATED
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Vikhr-Gemma-2B-instruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · mnsims1024
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
GE
humanizer-12b
Gemma · npario
Params11.9B
Context256K
Q4_K_M7.6 GB
Vision
GE
Gemma 4 Writers 31B V2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
Gemma 4 E4B Luchador
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
Roleplay
GE
Gemma4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
Vision
GE
Forge 1 Gemma 4 E2B
Gemma · YoSaNoo
Params4.63B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
GE
google gemma 2b it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic v2
Gemma · OS-Software
Params25.2B
Context256K
Smallest14.2 GB
Vision
GE
Docto Decision Gemma 4 E4B Fr v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 3 270m It
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 4 Gembrain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
GE
Gemma 4 26B A4B It Claude Opus Distill v2
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingReasoning
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · yuxinlu1
Params11.9B
Context128K
Q4_K_M7.4 GB
Reasoning
GE
Gemma 4 26B A4B Heretic Stable
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GE
Gemma-4-E2B-It
Gemma · UnitGrief
Params4.65B
Context128K
Q4_K_M3.1 GB
Vision
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF

Keep browsing