GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Mlabonne Gemma 3 12b It Abliterated v2
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
Vision
BA
Bangla Summarizer Pro GGUF
Bangla · emonHasan01
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Google Gemma 4 E2B It
Gemma · CQSystems
Params4.65B
Context128K
Smallest3.0 GB
ReasoningTool use
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MA
magnum v4 27b
Magnum · ihpocksnet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GA
Gama 4b
Gama · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
GemmaX2 28 9B v0.1
Gemma · Gemini
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
gemma 4 E4B finetune
Gemma · helenk
Params7.46B
Context128K
Q4_K_M5.3 GB
Reasoning
GE
hamma gemma 4 devops
Gemma · xayrullonematov
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gigantes v3 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3n E2B It
Gemma · tatsuyaaaaaaa
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
KA
KavithaSaaram 2b it
Kavithasaaram · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
HE
Heretic.Erudite 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma3 9b It Girl v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
G2 9B Sugarquill v0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GW
GWQ 9B Preview
Gwq · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SE
SEX_ROLEPLAY 2B
Sex · Novaciano
Params2.61B
Context8K
Smallest1.5 GB
Roleplay
GE
Gemma 2 Baku 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 2b Base
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
LL
Gemma 2 Llama Swallow 2b It v0.1
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
GemmaX2 28 9B v0.2
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
TI
TinyRP 0.3B
Tinyrp · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Roleplay
TH
Novaciano Think.NPC 1B
Think · Flexan
Params1B
Context32K
Q4_K_M0.8 GB
ReasoningRoleplay
NU
NUXARA AI V1
Nuxara · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
FI
Firefly v5 Alpha Testing
Firefly · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 2 2b
Gemma · xriminact
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
YA
YanoljaNEXT Rosetta 12B
Yanoljanext · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
gemma2 gutenberg 9B
Gemma · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E4B
Gemma · Lsdemon
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use

Keep browsing