GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Gigantes v2 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma4 e4b glados
Gemma · 3ndetz
Params7.52B
Context128K
Smallest5.4 GB
GE
PE Type 3 Nova 4B
Gemma · vanta-research
Params3.88B
Context128K
Smallest4.1 GB
TE
Tema_Q X
Tema · kawasumi
Params9.24B
Context8K
Q4_K_M5.8 GB
AR
arbiter v4 12b
Arbiter · hiteshluke
Params12.9B
Context256K
Q4_K_M7.9 GB
GE
Gemma 3 4b It
Gemma · s3dev-ai
Params3.88B
Context128K
Q4_K_M2.5 GB
CR
Crow 9B It
Crow · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
magnum v3 9b customgemma2
Gemma · anthracite-org
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 3 270m ticket router
Gemma · kgptalkie
Params268M
Context32K
Q4_K_M0.3 GB
AL
G2 9B Aletheia v1
Aletheia · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
SP
spoomplesmaxx whiskeyjack 12B i1
Spoomplesmaxx · aimeri
Params12.9B
Context256K
Q4_K_M7.9 GB
GE
gemma 4 12B it RotorQuant GGUF Q3 K M
Gemma · majentik
Params11.9B
Context256K
Smallest6.1 GB
GE
Gemma 2 2b Jpn It
Gemma · grapevine-AI
Params2.61B
Context8K
Q4_K_M1.7 GB
SA
Safeword Casual V1 R1 12B
Safeword · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
SM
Smilodon 9B v1
Smilodon · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma2 9b it for tripadvisor v4 5 samples
Gemma · hienbm
Params9.24B
Context8K
Q4_K_M5.8 GB
GW
prithivMLmods.GWQ 9B Preview
Gwq · DevQuasar-2
Params9.24B
Context8K
Q4_K_M5.8 GB
TO
Toxic.NPC 1B
Toxic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 12b It
Gemma · s3dev-ai
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 2 2b Jpn It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
MT1 Gen7 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · jaromer
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma4 E2b SOQL QLORA
Gemma · ravinarayanan
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2 2b Jpn It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
lemon-mint/gemma-2b-translation-v0.140
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
TR
Translategemma 27b It
Translategemma · 42ailab
Params27B
Context128K
Q4_K_M16.5 GB
GE
Floppa 12B Gemma3 Uncensored
Gemma · QrCode99
Params11.8B
Context128K
Smallest12.5 GB
VI
Vietron 4b
Vietron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
SARC Taigi LLM 27b
Gemma · Speech-AI-Research-Center
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 1b It
Gemma · fernandoruiz
Params1B
Context32K
Smallest0.7 GB