GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma2
Gemma · cortexso
Params27.2B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 Baku 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 Earthen Completion v0.1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Saiga_Gemma3_12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
typhoon2.1 gemma3 12b
Gemma · typhoon-ai
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningTool use
TU
TurboGemma4E2B v2
Turbogemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
ME
MedBarcenas 4b Hemodialisis
Medbarcenas · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SY
SystemGemma2 9b It
Systemgemma · RichardErkhov
Params9.24B
Context32K
Q4_K_M5.8 GB
GGUF
OM
Omega Darker v1 R1 4B
Omega · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplay
GE
typhoon2.1 gemma3 4b
Gemma · typhoon-ai
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
GE
Gemma 4 26B A4B It Abliterix v6
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
ProtoSex RP Gemma2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Roleplay
GE
Gemma 3 27B IT
Gemma · brittlewis12
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 4b It Roleplay Tuned v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
GE
Gemma 4 E2B Heretic
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma 3 27b It Abliterated Normpreserve
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SC
Scout 4b
Scout · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplay
XT
Xthos v2 The Sovereign Architect
Xthos · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SU
G2 9B Sugarquill v0
Sugarquill · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 27b it lecore
Gemma · staccs
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Heretic
Gemma · scrybz
Params30.7B
Context256K
Smallest35.0 GB
CodingReasoningTool use
DA
Dante 9B i1
Dante · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LI
Lilith 31B v1.0
Lilith · darthcrawl
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
Gemma 3 4b It Heretic Logic
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · Kismi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
amethyst 1 mini
Gemma · VertexAGI
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
GE
gemma-3n-E4B-it
Gemma · Mungert
Params6.87B
Context32K
Q4_K_M4.8 GB
Vision
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · gmonsoon
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing