GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gigantes v2 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma4 e4b glados
Gemma · 3ndetz
Params7.52B
Context128K
Smallest5.4 GB
ReasoningRoleplayTool use
GE
PE Type 3 Nova 4B
Gemma · vanta-research
Params3.88B
Context128K
Smallest4.1 GB
RoleplayVision
TE
Tema_Q X
Tema · kawasumi
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
AR
arbiter v4 12b
Arbiter · hiteshluke
Params12.9B
Context256K
Q4_K_M7.9 GB
ReasoningTool use
GE
Gemma 3 4b It
Gemma · s3dev-ai
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
CR
Crow 9B It
Crow · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
magnum v3 9b customgemma2
Gemma · anthracite-org
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 270m ticket router
Gemma · kgptalkie
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
AL
G2 9B Aletheia v1
Aletheia · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SP
spoomplesmaxx whiskeyjack 12B i1
Spoomplesmaxx · aimeri
Params12.9B
Context256K
Q4_K_M7.9 GB
ReasoningRoleplayTool use
GE
gemma 4 12B it RotorQuant GGUF Q3 K M
Gemma · majentik
Params11.9B
Context256K
Smallest6.1 GB
ReasoningTool use
GE
Gemma 2 2b Jpn It
Gemma · grapevine-AI
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SA
Safeword Casual V1 R1 12B
Safeword · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningRoleplayVision
SM
Smilodon 9B v1
Smilodon · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma2 9b it for tripadvisor v4 5 samples
Gemma · hienbm
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GW
prithivMLmods.GWQ 9B Preview
Gwq · DevQuasar-2
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TO
Toxic.NPC 1B
Toxic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Gemma 3 12b It
Gemma · s3dev-ai
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
MT1 Gen7 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · jaromer
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma4 E2b SOQL QLORA
Gemma · ravinarayanan
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 2 2b Jpn It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
lemon-mint/gemma-2b-translation-v0.140
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
TR
Translategemma 27b It
Translategemma · 42ailab
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Floppa 12B Gemma3 Uncensored
Gemma · QrCode99
Params11.8B
Context128K
Smallest12.5 GB
Vision
VI
Vietron 4b
Vietron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
SARC Taigi LLM 27b
Gemma · Speech-AI-Research-Center
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 1b It
Gemma · fernandoruiz
Params1B
Context32K
Smallest0.7 GB
GGUF

Keep browsing