GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MT1 Gen7 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FU
Functiongemma Mobileactions
Functiongemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PA
Parasite.NE Alpha 1B
Parasite · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
CO
Codegemma 2b
Codegemma · SkyNotion
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ME
Medgemma3 Thinking
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
GE
Gemma-3N-E4B-It
Gemma · tripolskypetr
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DA
Dante 9B
Dante · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Google.Gemma 3 1b It GGUF
Gemma · lex-au
Params1B
Context32K
Smallest0.7 GB
GGUF
GE
MT3 Gen5 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma4 tipo ko
Gemma · raspie
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
EM
Embeddinggemma 300m
Embeddinggemma · s3dev-ai
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
GE
Gemma 3 12b It Qat Abliterated
Gemma · fairy322
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 1b It
Gemma · h4shy
Params1B
Context32K
Smallest0.8 GB
GGUF
GE
supergemma4 26b uncensored gguf v2
Gemma · dolor4dollar
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Aisingapore Gemma2 9b Cpt Sea Lionv3 Instruct
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
Gemma 3 12B IT QAT Heretic MOE v1
Gemma · DmitryDB
Params11.8B
Context128K
Smallest6.6 GB
CodingVision
GE
Gemma 4 12B It Assistant
Gemma · colefuoco00
Params423M
Context256K
Smallest0.5 GB
GGUF
GE
lemon mint gemma 2 2b translation Iter5
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
RY
RyanYr last letter cat genRM pilot experiment
Ryanyr · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 R1984 27B
Gemma · openfree
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · OwenArli
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PR
Prototype Virus 1B
Prototype · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
CodingRoleplay
GE
AtomicGPT Gemma3 27b
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
google/gemma-2-2b-it
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · kingjones777
Params4.65B
Context128K
Smallest3.4 GB
ReasoningTool useVision
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · Iambackup
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 2 27b instruct
Gemma · kajuma
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 27b It
Gemma · paultimothymooney
Params27B
Context128K
Q4_K_M16.5 GB
Vision

Keep browsing