GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
gemma-2-9b-it-abliterated
Gemma · Alex01837178373
Params9.24B
Context8K
Q4_K_M5.8 GB
AP
Apollo2 9B
Apollo · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
TE
Tema_Q R4.2
Tema · kawasumi
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
symptary tagebuch
Gemma · belagoldmann
Params268M
Context32K
Smallest0.3 GB
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · sxiaa
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Ko Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
BO
Borealis 12b Instruct Preview
Borealis · NbAiLab
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
Gemma 3 27b Novision
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 3 27b instruct
Gemma · lm-kit
Params27B
Context128K
Q4_K_M16.5 GB
GE
MTM Merge gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma SEA LION v4 27B
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma3NPC 1b Float16
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 270m It
Gemma · s3dev-ai
Params268M
Context32K
Q4_K_M0.3 GB
GE
Dangvansam Gemma 2 9b It Fix System Role
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GE
MT3 Gen8 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
PsarAI Omni
Gemma · nphearum
Params4.65B
Context128K
Smallest0.0 GB
GH
GhostShell 4B
Ghostshell · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
IN
sulabhkatiyar/en-indic-translate-4b
Indic · sulabhkatiyar
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
VirgiF continue pretrain gemma
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Rocky Gemma 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma 2b recipes
Gemma · ClaireLee2429
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 E4B it qat text only Q4 K M
Gemma · phatvucoder
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Luel Gemma 3 4b Tigrinya
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
CO
codegemma-7b-it
Codegemma · qnixsynapse
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
BgGPT Gemma 3 12B IT
Gemma · AlexandorwBG
Params11.8B
Context128K
Smallest6.0 GB
GE
ArrowMint Gemma3 4B YUKI v0.1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Foggen Gemma3 1b
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 2 9b Medical
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 4b it
Gemma · llmware
Params7.52B
Context128K
Q4_K_M5.0 GB
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB