GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
The Omega Directive G 12B v1.0
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma-2-9b-it
Gemma · Dracones
Params9.24B
Context8K
Q4_K_M5.8 GB
NU
nudge task model
Nudge · johnybr99
Params268M
Context32K
Smallest0.1 GB
GE
Gemma3 Malignant.Schism 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GR
GRamma 12B
Gramma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
anakin87/gemma-2-2b-neogenesis-ita
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
NI
MBZUAI Paris.Nile Chat 4B
Nile · DevQuasar
Params3.88B
Context128K
Q4_K_M2.5 GB
DA
datagemma rig 27b it
Datagemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
gemma 4 12B it RotorQuant GGUF Q5 K M
Gemma · majentik
Params11.9B
Context256K
Smallest8.5 GB
GE
nbeerbower gemma2 gutenberg 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma V2 9B Instruct
Gemma · qnixsynapse
Params9.24B
Context8K
Smallest5.5 GB
GE
Gemma4 31B Uncensored HauhauCS 1M
Gemma · BahamutRU
Params30.7B
Context128K
Smallest0.3 GB
GE
GemmaTranslate v3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma2 9b Cpt Sea Lionv3 Base
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GH
GhostShell 4B
Ghostshell · DuoNeural
Params7.46B
Context128K
Q4_K_M5.3 GB
VI
Vikras MixP
Vikras · srs6901
Params2.03B
Context32K
Smallest1.1 GB
GE
Gemma 3 4b It
Gemma · MaoyueOUO
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma-4-12B-It
Gemma · llmware
Params11.9B
Context256K
Q4_K_M7.1 GB
SO
Sophia La.Sensible 2B
Sophia · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
lemon-mint/gemma-2b-translation-v0.122
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · DuoNeural
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Amethyst Core
Gemma · CodexCon-OS
Params1B
Context32K
Q4_K_M0.8 GB
MI
Mira v1.18 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 12b It Heretic v2
Gemma · zhangsanfeng364
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
EM
Embeddinggemma 300m
Embeddinggemma · sabafallah
Params308M
Context2K
Smallest0.3 GB
LL
Gemma 2 Llama Swallow 2b Pt v0.1
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
INSAIT Institute BgGPT Gemma 2 2.6B IT v1.0
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GE
Gemma 4 E4B
Gemma · jc-builds
Params7.52B
Context128K
Q4_K_M5.3 GB