GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
rubra ai gemma 1.1 2b it
Gemma · RichardErkhov
Params2.84B
Context8K
Q4_K_M1.8 GB
GE
MT Merge4 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Mlabonne.Gemma 3 27b It Abliterated v2
Gemma · DevQuasar
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 12b It Norm Preserved Biprojected Abliterated
Gemma · phi0112358
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 R1984 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3
Gemma · l3utterfly
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 3 4b instruct lmk
Gemma · lm-kit
Params3.88B
Context128K
Smallest7.8 GB
GE
Gemma 3 27b It Abliterated
Gemma · KnutJaegersberg
Params27B
Context128K
Smallest28.7 GB
GE
qwen3 q3 k l
Gemma · mahee12345
Params3.88B
Context40K
Smallest0.4 GB
FA
FabGemma
Fabgemma · naazimsnh02
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 12B TurboQuant GGUF IQ4 XS
Gemma · majentik
Params11.9B
Context256K
Smallest6.7 GB
GE
Mlabonne Gemma 3 12b It Qat Abliterated
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
GE
Gemma 3 270m
Gemma · kr4phy
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 3 27b Pt
Gemma · deltanym
Params27B
Context128K
Smallest22.2 GB
GE
MT1 Gen4 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 270m It Homeowner Classifier
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
BA
Barcenas 4b
Barcenas · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Phoenix_4B
Gemma · iwalton3
Params3.88B
Context128K
Smallest4.1 GB
GE
Rinna Gemma 2 Baku 2b
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
JW
jwang2373 UW SBEL ChronoGemma 27b it
Jwang · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Otak_2_2B_Gguf
Gemma · Berk-Bey
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Ganda Gemma 1b
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
LL
Gemma 2 Llama Swallow 9b Pt v0.1
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma-2-27b-it
Gemma · saejoon
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 2 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It
Gemma · iqbalamo93
Params11.8B
Context128K
Smallest12.5 GB
CO
codegemma-1.1-7b-it
Codegemma · alexcovo
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
poc mini trade npc
Gemma · aotoki
Params268M
Context32K
Smallest0.3 GB
GE
Gemma 4 E4B mirxa
Gemma · mirxa2
Params7.52B
Context128K
Q4_K_M5.3 GB