GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
The Omega Directive G 12B v1.0
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
RoleplayVision
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma-2-9b-it
Gemma · Dracones
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
NU
nudge task model
Nudge · johnybr99
Params268M
Context32K
Smallest0.1 GB
GGUF
GE
Gemma3 Malignant.Schism 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GR
GRamma 12B
Gramma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
anakin87/gemma-2-2b-neogenesis-ita
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
NI
MBZUAI Paris.Nile Chat 4B
Nile · DevQuasar
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
DA
datagemma rig 27b it
Datagemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma 4 12B it RotorQuant GGUF Q5 K M
Gemma · majentik
Params11.9B
Context256K
Smallest8.5 GB
ReasoningTool use
GE
nbeerbower gemma2 gutenberg 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma V2 9B Instruct
Gemma · qnixsynapse
Params9.24B
Context8K
Smallest5.5 GB
GGUF
GE
Gemma4 31B Uncensored HauhauCS 1M
Gemma · BahamutRU
Params30.7B
Context128K
Smallest0.3 GB
ReasoningTool useVision
GE
GemmaTranslate v3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma2 9b Cpt Sea Lionv3 Base
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GH
GhostShell 4B
Ghostshell · DuoNeural
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
VI
Vikras MixP
Vikras · srs6901
Params2.03B
Context32K
Smallest1.1 GB
ReasoningTool use
GE
Gemma 3 4b It
Gemma · MaoyueOUO
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma-4-12B-It
Gemma · llmware
Params11.9B
Context256K
Q4_K_M7.1 GB
ReasoningTool use
SO
Sophia La.Sensible 2B
Sophia · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Roleplay
GE
lemon-mint/gemma-2b-translation-v0.122
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 26B A4B It Abliterated
Gemma · DuoNeural
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Amethyst Core
Gemma · CodexCon-OS
Params1B
Context32K
Q4_K_M0.8 GB
Vision
MI
Mira v1.18 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 12b It Heretic v2
Gemma · zhangsanfeng364
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
EM
Embeddinggemma 300m
Embeddinggemma · sabafallah
Params308M
Context2K
Smallest0.3 GB
Embedding
LL
Gemma 2 Llama Swallow 2b Pt v0.1
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
INSAIT Institute BgGPT Gemma 2 2.6B IT v1.0
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
GE
Gemma 4 E4B
Gemma · jc-builds
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use

Keep browsing