GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
EZO2.5 Gemma 3 12b It Preview
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4b It
Gemma · ShahzebKhoso
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
HO
Home FunctionGemma 270m
Home · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
SI
silma ai SILMA 9B Instruct v0.1.1
Silma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 4b
Gemma · llmware
Params3.88B
Context128K
Smallest3.2 GB
Vision
GE
UCLA AGI Gemma 2 9B It SPPO Iter3
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
OM
Omega Darker v1 R1 4B
Omega · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplayVision
GE
Gemma3 Quiet.Hours 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
swahili gemma 1b
Gemma · CraneAILabs
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 2b Finance It v1
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
ORANSight Gemma 2 9B Instruct i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
HA
Hans_Wesker 1B
Hans · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
MI
Mimma 3 12b
Mimma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
MI
Mira v1.8 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
CraneAILabs_swahili Gemma 1b
Gemma · ThijsL202
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
kittylm gemma3 1b
Gemma · KittyLM
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 4 26B A4B it heretic APEX
Gemma · claymorecrystal
Params25.2B
Context256K
Smallest13.0 GB
CodingReasoningTool use
IR
Irodori TTS v4 Large audiocpp
Irodori · asfdrwe
Params—
Context—
Smallest4.2 GB
GGUF
GE
Gemma 2 Baku 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 12b It Uncensored
Gemma · Vegss
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 2 2b It
Gemma · gaianet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TR
translategemma 12b it subtitles
Translategemma · Chinasky71
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
MI
Mira v1.27 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Tool use
GE
Gemma 3 27b It Qat Abliterated
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GA
GaMS 9B Instruct DPO Translator
Gams · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1B Roblox Luau
Gemma · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
BU
ai4burmese padauk
Burmese · WYNN747
Params7.46B
Context128K
Smallest8.0 GB
Tool use
SH
Shieldgemma 27b
Shieldgemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Mahou-1.3-gemma2-9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing