GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma2 9b KuwaNovelist 2 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma ko 7b instruct v0.71
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
TA
Tanzania 0.3B
Tanzania · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Roleplay
GE
Gemma 3 270M IT
Gemma · brittlewis12
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 3 4b It
Gemma · Felladrin
Params3.88B
Context128K
Smallest2.4 GB
GGUF
GE
Gemma 3 12b It Abliterated v2
Gemma · Umpire1onight
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
The Omega Directive Gemma3 12B v1.0
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
WE
Webs Sejong 31B v2
Webs · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
MO
G4 Moonlight Dusk
Moonlight · debais
Params26B
Context256K
Smallest12.6 GB
ReasoningTool use
GE
Gemma2 9B KuwaNovelist v3
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ST
StoryGen 12B It
Storygen · turtle0001
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningVision
GE
gemma-2b-it
Gemma · ctx7
Params2.51B
Context8K
Smallest10.0 GB
GGUF
GE
Discord Gemma 4B V1 Done
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 3 270m it
Gemma · Mungert
Params268M
Context32K
Smallest0.0 GB
GGUF
TR
Translategemma 4b It
Translategemma · bingbangboom
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
BgGPT Gemma 3 27B IT
Gemma · beleata74
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
toolguard 1b
Gemma · CharanSripadi
Params1B
Context32K
Q4_K_M0.8 GB
Tool use
FI
Firefly v5 Alpha v2
Firefly · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
ArrowMint Gemma3 4B YUKI v0.1
Gemma · mmnga
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
MI
Mira v1.15 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
MTM Merge1 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · BnwoRt
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
DA
datagemma rig 27b it
Datagemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
GE
Gemma 4 31B it assistant
Gemma · Radamanthys11
Params470M
Context256K
Smallest0.5 GB
ReasoningTool use
GE
Google.Gemma 3 1b It
Gemma · DevQuasar-13
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 4 neon r2
Gemma · Sm0r3s
Params25.2B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
AriaV8
Gemma · SurgeFF
Params12.9B
Context256K
Q4_K_M7.9 GB
ReasoningTool useVision
GE
gemma4 cpu moe
Gemma · arunprasath
Params25.2B
Context256K
Smallest0.3 GB
ReasoningTool use
XT
Xthos v2 The Sovereign Architect
Xthos · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF

Keep browsing