GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 12b It
Gemma · eaddario
Params11.8B
Context128K
Q4_K_M6.4 GB
GGUF
KA
KavithaSaaram 9b it i1
Kavithasaaram · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
medical gemma 3n 4b
Gemma · ericrisco
Params6.87B
Context32K
Smallest13.7 GB
GGUF
SY
Synthia S1 27b
Synthia · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Saiga_Gemma3_12B
Gemma · IlyaGusev
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 12b It Norm Preserved Biprojected Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma4 12b Bioinfo
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma4 E4B It Disinhibited
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
lemon mint gemma ko 7b instruct v0.71
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Erebus RP 12B Instruct 2608 v1
Gemma · Indexnusrefather
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · aoiandroid
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 3 4b It Heretic
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
CodingVision
GE
Gemma 4 12B It Jbliterated v2
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Gemma 2 2B Stheno Filtered
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Nidum Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MO
PanShi Audit1.0 12B
Moon · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
EP
EpistemeAI codegemma 2 9b ultra i1
Epistemeai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12b It Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Gemma 4 E4B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · Abiray
Params7.5B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplay
AD
C3TR Adapter
Adapter · webbigdata
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-2-27b
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Nidum Gemma 3 27B It Uncensored
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
MI
Mimma 3 27b
Mimma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 27b It Abliterated Normpreserve
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 4 12B Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
gemma 2 baku 2b it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 27B MeditronFO
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
GE
Gemma 3 12b It
Gemma · second-state
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma-2-9B-Chinese-Chat-ckpt
Gemma · shenzhi-wang
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GL
Glitter_Boy 12b
Glitter · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningRoleplayTool use

Keep browsing