GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 12B It Jbliterated V12W P6
Gemma · ApolloRaines
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
gemma 4 19b a4b it REAP heretic APEX
Gemma · EmanuelOverride
Params18.4B
Context256K
Q4_K_M10.1 GB
Coding
GE
Huihui gemma 4 31B it qat abliterated MTP NVFP4
Gemma · RemySkye
Params30.7B
Context128K
Smallest0.5 GB
ReasoningTool useVision
KA
Karakuri Lm 7b Apm v0.1
Karakuri · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma SEA LION v3 9B IT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
ME
Merousis 26B A4B
Merousis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma 2 9b It
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E2B Home Assistant
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 3 4b It
Gemma · tonybucket
Params3.88B
Context128K
Smallest2.8 GB
Vision
GE
gemma 3 1b it Abliterated
Gemma · anlord
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · CCSSNE
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GW
GWQ 9B Preview2
Gwq · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-2-9b-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma4-12B-Uncensored
Gemma · toandev
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 4 12B it uncensored opus4.7 cot
Gemma · Rangle2
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced
Gemma · akpsahan
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
PopiT Gemma 3 12B Medical SFT 1218
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · tutuchen2000
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
magnum v3 9b chatml
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Vi Humanizer Gemma 4 E2B
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
gemma-2-9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Jailbreak EN
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma2 9b Cpt Sea Lionv3 Instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma4 E2B It Abliterated AND Disinhibited USE THIS
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
TR
translategemma 12b it Q4 K M
Translategemma · u3man
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 27b It Heretic v2
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
CodingVision
NE
GaMS 9B Instruct Nemotron
Nemotron · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing