GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MT5 Gen5 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · justfrfn
Params4.65B
Context128K
Smallest3.0 GB
ReasoningTool useVision
LL
Gemma 2 Llama Swallow 27b Pt v0.1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma3 12B claude 3.7 sonnet reasoning distilled
Gemma · mfielding92
Params11.8B
Context128K
Smallest12.5 GB
Reasoning
TU
Tucan 9B v1.0
Tucan · llm-bg
Params9.24B
Context8K
Q4_K_M5.8 GB
Tool use
PA
Parasite_Tyrant.T NE Beta 1B
Parasite · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Gemma 4 E4B It Assistant
Gemma · ManniX-ITA
Params79M
Context128K
Q4_K_M0.1 GB
Vision
GE
Gemma 3 4b Es Reasoning
Gemma · axiom-of-choice
Params3.88B
Context128K
Smallest2.4 GB
Reasoning
GE
Gemma 3n E2B It Absolute Heresy MPOA
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
Vision
GE
Gemma4 E4B Classifier
Gemma · igorls
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
CO
Codegemma 2b
Codegemma · itlwas
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
HOS 1
Gemma · Timelyyyy
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 12B it ROCmFP4
Gemma · kingjones777
Params11.9B
Context256K
Smallest0.5 GB
ReasoningTool useVision
ME
medgemma 4b it null space abliterated
Medgemma · jwest33
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 27b Tools
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Tool useVision
GE
Gemma 2 27b It Abliterated
Gemma · byroneverson
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
DA
datagemma rag 27b it
Datagemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 12b It Abliterated
Gemma · Otakadelic
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3n E4B It Absolute Heresy MPOA
Gemma · MuXodious
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Gemmoy 9B G2 MK.3 i1
Gemmoy · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Merged Atom 27b v2
Gemma · vanta-research
Params27B
Context128K
Smallest54.0 GB
ReasoningRoleplay
GE
Dark Pane
Gemma · mars2titan
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
TR
translategemma 4b it
Translategemma · Menterium
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Turkish-Gemma-9b-T1
Gemma · serkanpeker
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E2B It Assistant
Gemma · ManniX-ITA
Params78M
Context128K
Q4_K_M0.1 GB
Vision
GE
MT Merge8 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DA
Darkidol Chasm 4B
Darkidol · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
typhoon2.1 gemma3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
OP
openwebui-title-generator
Openwebui · gghfez
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
Gemma 4 E2B
Gemma · mhndayesh
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF

Keep browsing