GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
google gemma 3 4b it qat q4 0 gguf small
Gemma · stduhpf
Params3.88B
Context128K
Smallest2.4 GB
GE
gemma-1.1-2b-it
Gemma · qwp4w3hyb
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma-2-9B-Chinese-Chat
Gemma · gaianet
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 A4B 109e v3 It
Gemma · mradermacher
Params21.8B
Context256K
Q4_K_M14.5 GB
GE
gemma-2b-it
Gemma · reach-vb
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
wiroai turkish llm 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 27b It Abliterated
Gemma · youkoutenhouin
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 7b Custom Tokenizer Base
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
MIXdevAI gemma3 4B
Gemma · kirilldual0987
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 3 270m
Gemma · QuantFactory
Params436M
Context32K
Q4_K_M0.4 GB
NE
GaMS 27B Instruct Nemotron
Nemotron · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3 270m It
Gemma · tatsuyaaaaaaa
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 3 1b instruct
Gemma · Eahsanafra
Params1B
Context32K
Q4_K_M0.8 GB
HE
Hereticsutra 2B
Hereticsutra · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
BO
Borealis Open 270m
Borealis · NbAiLab
Params268M
Context32K
Q4_K_M0.3 GB
GE
lemon-mint/gemma-ko-1.1-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
NE
Nemesis.T Type
Nemesis · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
MI
Mira v1.17 27B Custom Heretic
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SO
Sorachio 1B
Sorachio · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
EZO-Common-9B-gemma-2-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-3-1B-It
Gemma · manojbillionaire123
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · michaelborg
Params7.52B
Context128K
Q4_K_M5.3 GB
SI
silma ai SILMA 9B Instruct v1.0
Silma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 Ataraxy v4d 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It
Gemma · recursechat
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 2 2b jpn it abliterated 17
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · abrasdaosfjnps
Params7.52B
Context128K
Q4_K_M5.3 GB
PS
Psychosis 9B v1
Psychosis · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Mimma 3 12b
Mimma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB