GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
CH
chat
Chat · gguf-org
Params1B
Context32K
Smallest0.7 GB
GE
Gemma 2 9B It SPPO Iter1
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 Baku 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3n E2B It Absolute Heresy
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GL
Glitter Boy 2.0
Glitter · ChonkE
Params11.9B
Context128K
Smallest12.7 GB
TR
Translategemma 4b It
Translategemma · aoiandroid
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 Earthen v0.1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 E4B Heretic
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E2B It
Gemma · Renesas
Params4.65B
Context128K
Smallest9.3 GB
GE
Amoral Fallen Omega Gemma3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
AL
UmbrellaInc Albert_Wesker 1B
Albert · Flexan
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4b It Heretic Creative
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Google Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GE
Distil PII Gemma 3 270m It
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 2 9b It
Gemma · Bluerosesbutterfly
Params9.24B
Context8K
Q4_K_M5.8 GB
JA
JapanRailwayLLM
Japanrailwayllm · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma3 Heretic.Singularity 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · justtuananh
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
lemon mint gemma 2b translation v0.140
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
MT2 Gen2_gemma 3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Ko Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Google.Gemma 3 1b Pt
Gemma · DevQuasar-5
Params1B
Context32K
Q4_K_M0.8 GB
GE
google/gemma-2b-aps-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Google Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GE
Anima Light v8
Gemma · Christeck
Params1B
Context32K
Q4_K_M0.8 GB
AM
Amoral.Extreme 1B
Amoral · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 4 31B It Abliterated
Gemma · lhca521
Params30.7B
Context256K
Q4_K_M18.7 GB
SI
SILMA 9B Instruct v1.0
Silma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
CO
google/codegemma-1.1-2b
Codegemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma3 12b En Indic Mt
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB