GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 26B A4B
Gemma · Radamanthys11
Params420M
Context256K
Smallest0.5 GB
GGUF
HO
Horiza RAG Base 8b
Horiza · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GO
Dark Goetia 26B A4B LoRA RU v1
Goetia · SubMaroon
Params12M
Context—
Smallest0.0 GB
GGUF
GE
Gemmoy-9B-MK.I
Gemmoy · backyardai
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TR
Translategemma 27b It
Translategemma · hisuiiki
Params27B
Context128K
Smallest28.7 GB
Vision
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DE
Delirium v1 Abliterated
Delirium · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TR
Translategemma 12b It
Translategemma · 42ailab
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
MI
Mira v1.23.1 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 12b It Antislop De
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 Earthen v0.2 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3n E4B It
Gemma · Qwe1325
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Gemma 2 2b Jpn It Abliterated 18
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
HODACHI EZO Common 9B gemma 2 it
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TU
Tucan 2.6B v1.0
Tucan · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Tool use
GE
Gemma3.Paradox.V2.121
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma4 4b Sci Gguf
Gemma · michelinolinolino
Params7.52B
Context128K
Smallest8.0 GB
GGUF
GE
PD_gemma 3n E4B v2
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemma2-9B-it-Boku-v1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
lemon mint gemma 2 2b translation Iter3
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TE
Tema_Q R3.1
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b Novision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
MI
Mira v1.18 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
FU
frumscupper andrew 1
Functiongemma · OGlaisin
Params268M
Context32K
Smallest0.3 GB
Tool use
GE
gemma 2 9b it Uncensored DeLMAT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · KnutJaegersberg
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 27B Character Creator V2
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
RoleplayVision
GE
Gemma 3 1b It
Gemma · Brianpuz
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LU
lumichats_4Bz_v1.4
Lumichats · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · 0721088A
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision

Keep browsing