GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Mlabonne Gemma 3 12b It Abliterated v2
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
BA
Bangla Summarizer Pro GGUF
Bangla · emonHasan01
Params1B
Context32K
Q4_K_M0.8 GB
GE
Google Gemma 4 E2B It
Gemma · CQSystems
Params4.65B
Context128K
Smallest3.0 GB
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MA
magnum v4 27b
Magnum · ihpocksnet
Params27.2B
Context8K
Q4_K_M16.6 GB
GA
Gama 4b
Gama · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
GemmaX2 28 9B v0.1
Gemma · Gemini
Params9.24B
Context8K
Smallest3.8 GB
GE
gemma 4 E4B finetune
Gemma · helenk
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
hamma gemma 4 devops
Gemma · xayrullonematov
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gigantes v3 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3n E2B It
Gemma · tatsuyaaaaaaa
Params4.46B
Context32K
Q4_K_M2.8 GB
KA
KavithaSaaram 2b it
Kavithasaaram · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
HE
Heretic.Erudite 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma3 9b It Girl v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
G2 9B Sugarquill v0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GW
GWQ 9B Preview
Gwq · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
SE
SEX_ROLEPLAY 2B
Sex · Novaciano
Params2.61B
Context8K
Smallest1.5 GB
GE
Gemma 2 Baku 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2 2b Base
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
LL
Gemma 2 Llama Swallow 2b It v0.1
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
GemmaX2 28 9B v0.2
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
TI
TinyRP 0.3B
Tinyrp · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
TH
Novaciano Think.NPC 1B
Think · Flexan
Params1B
Context32K
Q4_K_M0.8 GB
NU
NUXARA AI V1
Nuxara · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
FI
Firefly v5 Alpha Testing
Firefly · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2 2b
Gemma · xriminact
Params2.61B
Context8K
Q4_K_M1.7 GB
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma2 gutenberg 9B
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 E4B
Gemma · Lsdemon
Params7.52B
Context128K
Q4_K_M5.3 GB