GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 E4B Agentic Opus Reasoning GeminiCLI
Gemma · fv78pd
Params7.52B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
DH
Dhruv 27B
Dhruv · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 Fornax V3 27B
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
SI
SILMA Kashif 2B Instruct v1.0
Silma · tensorblock
Params2.61B
Context12K
Smallest1.2 GB
GGUF
GE
Magnolia v1 Gemma2 8k 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 it
Gemma · ddh0
Params11.8B
Context32K
Smallest1.1 GB
Vision
GE
Rocky Gemma 2b
Gemma · Phani1479432
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Black Onyx 5B
Gemma · Clownstein
Params4.63B
Context128K
Smallest3.0 GB
CodingReasoningTool use
GE
Gemma 2 2b Jpn It Abliterated 18
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma 3 4b It
Gemma · fernandoruiz
Params3.88B
Context128K
Smallest2.4 GB
Vision
CO
Codegemma 7b
Codegemma · itlwas
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · Vegss
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GR
GMiDo-1B
Graft · SmallAICreator
Params1.18B
Context4K
Smallest1.0 GB
Tool use
GE
kofu 2b edge
Gemma · shebxyd
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Aryabhatta-Gemma2-9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Sherckuith
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GA
GaMS3 12B
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
MT2 Gen11 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira V1.19.3C 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Google Gemma 4 31B It
Gemma · CQSystems
Params30.7B
Context256K
Smallest18.7 GB
ReasoningTool use
GE
gemma 4 12B coder fable5 composer2.5 v1 steer
Gemma · tpls
Params11.9B
Context256K
Smallest0.0 GB
GGUF
GE
CQ Gemma 4 26B A4B It
Gemma · CQSystems
Params25.2B
Context256K
Smallest16.8 GB
CodingReasoningTool use
GE
INSAIT Institute.BgGPT Gemma 2 27B IT v1.0
Gemma · DevQuasar-3
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
google gemma 3 27b
Gemma · cPilotGod
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3n E4B It
Gemma · mradermacher
Params6.87B
Context32K
Smallest2.8 GB
GGUF
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TR
Turaco gem mt en wes
Translategemma · fotiecodes
Params3.88B
Context128K
Smallest7.8 GB
Vision
GE
thai research gemma 3 27b it
Gemma · nectec
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
GE
Huihui Gemma 3n E2B It Abliterated
Gemma · matrixportalx
Params4.46B
Context32K
Q4_K_M2.8 GB
Vision
SU
supergemma4 26b abliterated multimodal gguf 4bit
Supergemma · kof1467
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision

Keep browsing