GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
lemon-mint/gemma-2b-translation-v0.90
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
chyon gemma 4 gguf v2
Gemma · arabellako22
Params4.65B
Context128K
Q4_K_M3.4 GB
KI
Kizagan E4B Turkish Agent FunctionCalling Hermes
Kizagan · Tuguberk
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Hanu
Gemma · Vijaypathy88
Params4.65B
Context128K
Q4_K_M2.7 GB
GE
Gemma 3 270m
Gemma · NikolayKozloff
Params268M
Context32K
Smallest0.3 GB
TH
Think.NPC 1B
Think · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4b It Abliterated
Gemma · jeiku
Params3.88B
Context128K
Smallest2.4 GB
CO
Codegemma 2b
Codegemma · LiteLLMs
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
quantized codegemma 7b it
Gemma · c516a
Params7B
Context—
Q4_K_M0.0 GB
CO
codegemma-1.1-7b-it
Codegemma · MoMonir
Params8.54B
Context8K
Q4_K_M5.3 GB
SJ
SJT 2.5B i1
Sjt · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
PO
PolDense-1B
Poldense · kprzyb
Params1.03B
Context8K
Smallest1.1 GB
GE
gemma 2 baku 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Hebrew_Lyrics Gemma2_2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma4 Gutenberg Literotica 12B
Gemma · alexnt2
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 12B coder fable5 composer2.5 v1 GGUF etheroi
Gemma · developerjeremylive
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma4NPC it
Gemma · spy5er
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · faizonly5953
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2b It
Gemma · indiansatoshi
Params2.61B
Context8K
Q4_K_M1.7 GB
HE
Heretic.Erudite 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
TR
translategemma 3 12b instruct lmk
Translategemma · lm-kit
Params11.8B
Context128K
Smallest23.5 GB
GE
gemma 4 12B coder fable5 composer2.5 v1 sft
Gemma · tpls
Params11.9B
Context256K
Q4_K_M8.6 GB
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 31b it IQ2 M
Gemma · KikoCis
Params30.7B
Context256K
Smallest10.9 GB
GE
Gemma 3 27b It
Gemma · gghfez
Params27B
Context128K
Smallest15.6 GB
GA
GaMS 2B Instruct
Gams · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
EM
amem embeddinggemma r1
Embeddinggemma · KiyoZVS
Params308M
Context2K
Smallest0.3 GB
ON
Oni_Mitsubishi_12B_Vision
Oni · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
BgGPT Gemma 3 27B IT V2 GGUF mmproj
Gemma · beleata74
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma-1.1-7b-it
Gemma · qwp4w3hyb
Params8.54B
Context8K
Q4_K_M5.3 GB