Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 31B It Arli
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
incisolr gemma 2b instruct ft datascienceinterview qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Lehja RP Gemma 4 26B A4B v0.1
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma 4 12B it Uncensored Heretic NVFP4
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest7.0 GB
ReasoningTool useVision
GE
Gemma writer stock no Ifable 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Hercules Gemma 3N It Stem
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemma 3 1b It Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
RollMind v1 Gemma1.1 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Roleplay
GE
Gemma 3 12b Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 2 Ataraxy v2a 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
SauerkrautLM Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4B IT ES SynthDolly 1A E3
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 1b It
Gemma · Martin7374
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 21B
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
ReasoningTool use
GE
Gemma 3 12b It Heretic v2
Gemma · CCSSNE
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GE
Bella Bartender Gemma E2B
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Google.Gemma 3n E4B It
Gemma · DevQuasar
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Coder3101_Gemma_4_E2B_It_Heretic
Gemma · Stabhappy
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
GE
gemma-2b-ForexAI
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Prompt Enhancer Gemma 3 270m It
Gemma · AlfRjw
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
Gemma 4 26b A4B It
Gemma · Krasnopjorovs
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Agri R Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma-4-E4B
Gemma · danbev
Params7.52B
Context128K
Smallest8.0 GB
GGUF
GE
yhkim9362 gemma en ko 7b v0.1
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
AXCXEPT EZO Humanities 9B gemma 2 it
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
recoilme gemma 2 9B v0.5
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma3_4B_Mulitmodal_Sft_02 02 2026
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
hina gemma4 12b balanced q4km browser
Gemma · Sido
Params11.9B
Context256K
Smallest7.4 GB
ReasoningTool use

Keep browsing