GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
CH
chat
Chat · gguf-org
Params1B
Context32K
Smallest0.7 GB
GGUF
GE
Gemma 2 9B It SPPO Iter1
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 Baku 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3n E2B It Absolute Heresy
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
GL
Glitter Boy 2.0
Glitter · ChonkE
Params11.9B
Context128K
Smallest12.7 GB
ReasoningRoleplayTool use
TR
Translategemma 4b It
Translategemma · aoiandroid
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 Earthen v0.1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GE
Gemma 4 E4B Heretic
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 E2B It
Gemma · Renesas
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
GE
Amoral Fallen Omega Gemma3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
AL
UmbrellaInc Albert_Wesker 1B
Albert · Flexan
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Gemma 3 4b It Heretic Creative
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Google Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
GE
Distil PII Gemma 3 270m It
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 2 9b It
Gemma · Bluerosesbutterfly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
JA
JapanRailwayLLM
Japanrailwayllm · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma3 Heretic.Singularity 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · justtuananh
Params11.9B
Context128K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
lemon mint gemma 2b translation v0.140
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
MT2 Gen2_gemma 3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Ko Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Google.Gemma 3 1b Pt
Gemma · DevQuasar-5
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
google/gemma-2b-aps-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Google Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
Anima Light v8
Gemma · Christeck
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
AM
Amoral.Extreme 1B
Amoral · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Gemma 4 31B It Abliterated
Gemma · lhca521
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
SI
SILMA 9B Instruct v1.0
Silma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CO
google/codegemma-1.1-2b
Codegemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma3 12b En Indic Mt
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision

Keep browsing