Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Frank 26B A4B GGUFs
Gemma · TendieLabs
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Iris 12B Gemma 4 It Qat
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma-4-31B-It
Gemma · fractaldactal
Params30.7B
Context256K
Q4_K_M18.3 GB
GE
Fallen Gemma3 27B v1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 1b It
Gemma · qwp4w3hyb
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 27b It Antislop
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 3 12b it null space abliterated
Gemma · jwest33
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
models--mergekit-community--mergekit-slerp-dclolyo
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 2b It SFT D1_chosen Orca
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 1.1 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Google Gemma 3 27b It Text
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma2 9b cpt sahabatai v1 instruct
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MultimodalTopic 27B Gemma3 Flash
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Jokes Sft Gemma 3 12b v2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
malama aira 9b
Gemma · IhArmayau
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
hina gemma4 e4b aggressive q4km browser
Gemma · Sido
Params7.52B
Context128K
Smallest4.6 GB
GE
Gemma SEA LION v4 27B VL
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 4 E4B It Heretic Ara
Gemma · MoonRide
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · gagarin346567
Params11.9B
Context256K
Smallest0.9 GB
GE
VeriCoder_Gemma12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 31B It
Gemma · steampunque
Params30.7B
Context256K
Smallest17.6 GB
GE
Gemma 2 Baku 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
PA heretic
Gemma · akpsahan
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 1b It Abliterated v2
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Sapie Gemma2 9B IT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
SauerkrautLM-Gemma-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 31B it qat q4 0 assistant
Gemma · Gabriel31173
Params470M
Context256K
Smallest0.4 GB
GE
hina gemma4 e2b aggressive iq3m browser
Gemma · Sido
Params4.65B
Context128K
Smallest3.1 GB
GE
Gemma 4 typescript coder 12b
Gemma · MassivDash
Params11.9B
Context256K
Q4_K_M7.4 GB