GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
DA
Dark Goetia 26B A4B v4
Dark · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
Gemma-3N-E4B-It
Gemma · Sci-fi-vy
Params6.87B
Context32K
Q4_K_M4.5 GB
Vision
GE
Gemma 7b It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 E4B it Hi Fi fraQtl
Gemma · qualcomm-ai-hub-community
Params7.52B
Context128K
Q4_K_M5.4 GB
ReasoningTool use
MA
magnum v3 9b chatml
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
BgGPT Gemma 2 27B IT v1.0
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
SH
Shieldgemma 9b
Shieldgemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GGUF
GH
GhostShell 4B
Ghostshell · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
TU
LLMBG ToolUse 9B v1.0
Tucan · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Tool use
CO
models--google--codegemma-7b
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 2b
Gemma · QuantFactory
Params7.62B
Context128K
Q4_K_M4.7 GB
GGUF
GE
Gemma 3 27b It PaperWitch Heresy
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 4b It Claude
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
TU
LLMBG ToolUse 9B v1.0
Tucan · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Tool use
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
sovereign anthology gemma 2 2b
Gemma · KolmogorovAcc
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma-4-E4B-Nightcap
Gemma · andyoneal
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
GE
Gemma4 Hermes Tools
Gemma · brokencircuitranch
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Gemma 4 12B It Jbliterated v2
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 3 4b It
Gemma · chatpig
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma 2 9b it Uncensored DeLMAT i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · MCZK
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DI
DiffusionGemma 26B A4B it ROCmFP4
Diffusiongemma · kingjones777
Params25.3B
Context256K
Smallest14.4 GB
GGUF
LL
Gemma 2 Llama Swallow 9b It v0.1
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · kamjin
Params4.65B
Context128K
Smallest3.0 GB
ReasoningTool useVision
GE
Ada Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
HE
Heretic Rp Vision 31b
Heretic · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
Gemma 3 12b It Qat Int4 Unquantized Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
BgGPT Gemma 3 12B IT
Gemma · INSAIT-Institute
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision

Keep browsing