GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
rubra ai gemma 1.1 2b it
Gemma · RichardErkhov
Params2.84B
Context8K
Q4_K_M1.8 GB
GGUF
GE
MT Merge4 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Mlabonne.Gemma 3 27b It Abliterated v2
Gemma · DevQuasar
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 12b It Norm Preserved Biprojected Abliterated
Gemma · phi0112358
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 R1984 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3
Gemma · l3utterfly
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 4b instruct lmk
Gemma · lm-kit
Params3.88B
Context128K
Smallest7.8 GB
Vision
GE
Gemma 3 27b It Abliterated
Gemma · KnutJaegersberg
Params27B
Context128K
Smallest28.7 GB
Vision
GE
qwen3 q3 k l
Gemma · mahee12345
Params3.88B
Context40K
Smallest0.4 GB
Vision
FA
FabGemma
Fabgemma · naazimsnh02
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 4 12B TurboQuant GGUF IQ4 XS
Gemma · majentik
Params11.9B
Context256K
Smallest6.7 GB
GGUF
GE
Mlabonne Gemma 3 12b It Qat Abliterated
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
Vision
GE
Gemma 3 270m
Gemma · kr4phy
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 3 27b Pt
Gemma · deltanym
Params27B
Context128K
Smallest22.2 GB
Vision
GE
MT1 Gen4 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 270m It Homeowner Classifier
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
BA
Barcenas 4b
Barcenas · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Phoenix_4B
Gemma · iwalton3
Params3.88B
Context128K
Smallest4.1 GB
Vision
GE
Rinna Gemma 2 Baku 2b
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
JW
jwang2373 UW SBEL ChronoGemma 27b it
Jwang · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Otak_2_2B_Gguf
Gemma · Berk-Bey
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Ganda Gemma 1b
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LL
Gemma 2 Llama Swallow 9b Pt v0.1
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-2-27b-it
Gemma · saejoon
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · iqbalamo93
Params11.8B
Context128K
Smallest12.5 GB
Vision
CO
codegemma-1.1-7b-it
Codegemma · alexcovo
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
poc mini trade npc
Gemma · aotoki
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
Gemma 4 E4B mirxa
Gemma · mirxa2
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision

Keep browsing