Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Tiger-Gemma-9B-v1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
ClickBook Gemma 4 E2B multi IQ4 XS
Gemma · Clickbook
Params4.33B
Context128K
Smallest1.8 GB
GE
goodmeet gemma 4 E2B live summary BF16
Gemma · bretdabaker
Params4.63B
Context128K
Smallest9.3 GB
GE
gemma 4 12B coder fable5 composer2.5
Gemma · sakamakismile
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 3n E4B It Abliterated
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
gemma 4 12B it qat assistant MTP Q4 0
Gemma · ysong21
Params423M
Context256K
Smallest0.3 GB
GE
IndicTrans3 Gemma Beta
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GE
Gemma 4 12B StyleTune QAT
Gemma · alexisStacksCode
Params11.9B
Context256K
Smallest0.3 GB
GE
Gemma Ataraxy Dare 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 E4B It Uncensored
Gemma · ccharnkij
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 Starshine 12B Alt
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 31B Mergemaxxed
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 12B It Esper4FableComposer
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 9B Base i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 31B storymaxxed2
Gemma · MRockatansky
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
GrayLine Gemma3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
heretic_Gemma 3 R1 4B v1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 E4B It Uncensored MAX Opus 4.7
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
gemma-1.1-2b-it
Gemma · second-state
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 2 27b It Abliterated
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
alpindale gemma 2b it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma ko 7b it v0.41 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 3 4b It Abliterated v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma2 Alicia 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma3 12b Tolkien_V2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma-4-E2B-it
Gemma · sphaela
Params4.65B
Context128K
Q4_K_M3.3 GB
GE
Spintax Generation Gemma 3 27b
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemuma Gemma 4 E4B
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB