GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
google gemma 3 4b it qat q4 0 gguf small
Gemma · stduhpf
Params3.88B
Context128K
Smallest2.4 GB
Vision
GE
gemma-1.1-2b-it
Gemma · qwp4w3hyb
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma-2-9B-Chinese-Chat
Gemma · gaianet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 A4B 109e v3 It
Gemma · mradermacher
Params21.8B
Context256K
Q4_K_M14.5 GB
ReasoningTool use
GE
gemma-2b-it
Gemma · reach-vb
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
wiroai turkish llm 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b It Abliterated
Gemma · youkoutenhouin
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 7b Custom Tokenizer Base
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
MIXdevAI gemma3 4B
Gemma · kirilldual0987
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 3 270m
Gemma · QuantFactory
Params436M
Context32K
Q4_K_M0.4 GB
GGUF
NE
GaMS 27B Instruct Nemotron
Nemotron · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 270m It
Gemma · tatsuyaaaaaaa
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 1b instruct
Gemma · Eahsanafra
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
HE
Hereticsutra 2B
Hereticsutra · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BO
Borealis Open 270m
Borealis · NbAiLab
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
lemon-mint/gemma-ko-1.1-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
NE
Nemesis.T Type
Nemesis · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
MI
Mira v1.17 27B Custom Heretic
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SO
Sorachio 1B
Sorachio · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
EZO-Common-9B-gemma-2-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-3-1B-It
Gemma · manojbillionaire123
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · michaelborg
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
SI
silma ai SILMA 9B Instruct v1.0
Silma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 Ataraxy v4d 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · recursechat
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma 2 2b jpn it abliterated 17
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · abrasdaosfjnps
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
PS
Psychosis 9B v1
Psychosis · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
MI
Mimma 3 12b
Mimma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF

Keep browsing