GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma-2-9b-it-abliterated
Gemma · Alex01837178373
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
AP
Apollo2 9B
Apollo · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
Tema_Q R4.2
Tema · kawasumi
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
symptary tagebuch
Gemma · belagoldmann
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · sxiaa
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Ko Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
BO
Borealis 12b Instruct Preview
Borealis · NbAiLab
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
GE
Gemma 3 27b Novision
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
gemma 3 27b instruct
Gemma · lm-kit
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
MTM Merge gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma SEA LION v4 27B
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma3NPC 1b Float16
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 270m It
Gemma · s3dev-ai
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Dangvansam Gemma 2 9b It Fix System Role
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
MT3 Gen8 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
PsarAI Omni
Gemma · nphearum
Params4.65B
Context128K
Smallest0.0 GB
GGUF
GH
GhostShell 4B
Ghostshell · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
IN
sulabhkatiyar/en-indic-translate-4b
Indic · sulabhkatiyar
Params7.52B
Context128K
Q4_K_M5.3 GB
GGUF
GE
VirgiF continue pretrain gemma
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Rocky Gemma 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 2b recipes
Gemma · ClaireLee2429
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 E4B it qat text only Q4 K M
Gemma · phatvucoder
Params7.46B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GE
Luel Gemma 3 4b Tigrinya
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
GGUF
CO
codegemma-7b-it
Codegemma · qnixsynapse
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
BgGPT Gemma 3 12B IT
Gemma · AlexandorwBG
Params11.8B
Context128K
Smallest6.0 GB
Vision
GE
ArrowMint Gemma3 4B YUKI v0.1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Foggen Gemma3 1b
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 9b Medical
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 4b it
Gemma · llmware
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing