GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mira v1.14 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · 7tianan
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
TE
Tema_Q R15.6
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira M2
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
kittylm gemma3 4b
Gemma · KittyLM
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 E2B It
Gemma · san27079
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
AXCXEPT EZO Common 9B gemma 2 it
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 26B A4B it MXFP4 MOE
Gemma · FreedomAISVR
Params25.2B
Context256K
Smallest14.7 GB
ReasoningVision
AT
Atom v1 Preview 12b
Atom · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
GE
YuanZ77 gemma2b b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Huihui gemma 4 12B coder fable5 composer2.5 v1 abliterated
Gemma · XAEA12
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Gemma 2 2b It
Gemma · SanctumAI
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 4b It
Gemma · professorf
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
EM
embeddinggemma 300m
Embeddinggemma · cstr
Params308M
Context2K
Smallest0.3 GB
Embedding
MI
Mira v1.20 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4b Novision
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GW
GWQ 9B Preview2
Gwq · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira v1 Dpo 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
TR
Translategemma 4b It
Translategemma · DeltaKX
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 12B It Jbliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
SA
SAEVerbalizer 27B
Saeverbalizer · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Coding
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
CodingReasoning
GE
ArrowMint Gemma3 4B YUKI v0.1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
VI
Vietron 4b
Vietron · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Occitan Gemma 3 4b It Lora
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 2 2b jpn it abliterated 18
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
AT
Atlas Chat 27B
Atlas · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Magnolia v3 Gemma2 8k 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing