GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
gemma2
Gemma · cortexso
Params27.2B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2 Baku 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 Earthen Completion v0.1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Saiga_Gemma3_12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
typhoon2.1 gemma3 12b
Gemma · typhoon-ai
Params11.8B
Context128K
Q4_K_M7.3 GB
TU
TurboGemma4E2B v2
Turbogemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ME
MedBarcenas 4b Hemodialisis
Medbarcenas · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
SY
SystemGemma2 9b It
Systemgemma · RichardErkhov
Params9.24B
Context32K
Q4_K_M5.8 GB
OM
Omega Darker v1 R1 4B
Omega · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
typhoon2.1 gemma3 4b
Gemma · typhoon-ai
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 26B A4B It Abliterix v6
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
ProtoSex RP Gemma2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 27B IT
Gemma · brittlewis12
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 4b It Roleplay Tuned v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 E2B Heretic
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 3 27b It Abliterated Normpreserve
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SC
Scout 4b
Scout · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
XT
Xthos v2 The Sovereign Architect
Xthos · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
SU
G2 9B Sugarquill v0
Sugarquill · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 3 27b it lecore
Gemma · staccs
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Heretic
Gemma · scrybz
Params30.7B
Context256K
Smallest35.0 GB
DA
Dante 9B i1
Dante · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LI
Lilith 31B v1.0
Lilith · darthcrawl
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 4b It Heretic Logic
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 2b It
Gemma · Kismi
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
amethyst 1 mini
Gemma · VertexAGI
Params4.55B
Context128K
Q4_K_M2.9 GB
GE
gemma-3n-E4B-it
Gemma · Mungert
Params6.87B
Context32K
Q4_K_M4.8 GB
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · gmonsoon
Params9.24B
Context8K
Q4_K_M5.8 GB