Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 4 31B It Arli
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
incisolr gemma 2b instruct ft datascienceinterview qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Lehja RP Gemma 4 26B A4B v0.1
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 4 12B it Uncensored Heretic NVFP4
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest7.0 GB
GE
Gemma writer stock no Ifable 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Hercules Gemma 3N It Stem
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
Gemma 3 1b It Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
RollMind v1 Gemma1.1 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 3 12b Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 2 Ataraxy v2a 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
SauerkrautLM Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 4B IT ES SynthDolly 1A E3
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 1b It
Gemma · Martin7374
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 2 2b Jpn It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 21B
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
GE
Gemma 3 12b It Heretic v2
Gemma · CCSSNE
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Bella Bartender Gemma E2B
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Google.Gemma 3n E4B It
Gemma · DevQuasar
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
Coder3101_Gemma_4_E2B_It_Heretic
Gemma · Stabhappy
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
gemma-2b-ForexAI
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Prompt Enhancer Gemma 3 270m It
Gemma · AlfRjw
Params268M
Context32K
Smallest0.3 GB
GE
Gemma 4 26b A4B It
Gemma · Krasnopjorovs
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Agri R Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma-4-E4B
Gemma · danbev
Params7.52B
Context128K
Smallest8.0 GB
GE
yhkim9362 gemma en ko 7b v0.1
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
AXCXEPT EZO Humanities 9B gemma 2 it
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
recoilme gemma 2 9B v0.5
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma3_4B_Mulitmodal_Sft_02 02 2026
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
hina gemma4 12b balanced q4km browser
Gemma · Sido
Params11.9B
Context256K
Smallest7.4 GB