GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It MLX
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SI
SimplyAI 2B Uncensored
Simplyai · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mira v1.19.2 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SU
Supergemma4 E4B Abliterated
Supergemma · BernTheCreator
Params7.52B
Context128K
Smallest5.2 GB
ReasoningTool use
BO
Borealis 270m Instruct Preview
Borealis · NbAiLab
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
TR
Translategemma 4b It
Translategemma · vwdvaan
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma 4 12B it null space abliterated
Gemma · jwest33
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 3n E2B It
Gemma · dimasjt
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
GE
BgGPT Gemma 2 27B IT v1.0
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma3NPC 1b SOMPOA Heresy
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
CH
Chatter 12b v1
Chatter · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
TI
TinyRP 1.1B
Tinyrp · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Magnolia v2 Gemma2 8k 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 2 2b it
Gemma · google
Params2.61B
Context8K
Smallest10.5 GB
GGUF
HU
humanizerth thai 12B
Humanizerth · ZExnoz
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
gemma 2 27b
Gemma · lm-kit
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · wdxpro
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
gemma 4 12B it assistant
Gemma · ManniX-ITA
Params423M
Context256K
Q4_K_M0.3 GB
Vision
GE
gemma 2 2b neogenesis ita
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Embedding
MA
magnum v3 9b customgemma2
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mira v1.25 27B Wave
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · fuzzy1477
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
GE
lemon mint gemma 2 2b translation Iter1
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SH
Shieldgemma 9b
Shieldgemma · DevQuasar-3
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-26B-A4B-Chimera-X-Heretic
Gemma · KaviarLabs
Params26B
Context256K
Smallest18.7 GB
ReasoningTool use
SI
SILMA 9B Instruct v1.0
Silma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · dahara1
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing