GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mira V1.22.2B 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GA
GaMS 27B
Gams · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3n E4B It
Gemma · gaianet
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Google.Gemma 3n E2B It
Gemma · DevQuasar
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
SU
Supergemma4 26b Abliterated Multimodal
Supergemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
EP
EpistemeAI codegemma 2 9b ultra
Epistemeai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-1.1-7b-it
Gemma · second-state
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 3 1b It Qat Abliterated
Gemma · mlabonne
Params1B
Context32K
Q4_K_M0.8 GB
Vision
GE
Gemma 3 27b Tools
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Tool use
GE
gemma 2 2b jpn it abliterated 17 i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma 3 4b Tigrinya Qa
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
SahabatAI Lion 9B TIES v1 i1
Sahabatai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 2 2b neogenesis ita i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Embedding
GE
Gemma3 27b It Abliterated Normpreserve v1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
TR
translategemma 4b text
Translategemma · mydubber-org
Params3.88B
Context128K
Smallest2.5 GB
GGUF
MA
Magnum v4 9b Abliterated
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 4b it roleplay tuned v1
Gemma · Indexnusrefather
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
RiverCub Gemma 3 27B Impotent Heresy
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
NO
2B_or_not_2B
Not · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma3 4b It Abliterated Normpreserve 3
Gemma · YanLabs
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 26B A4B It Assistant
Gemma · cafkafk
Params420M
Context256K
Q4_K_M0.3 GB
GGUF
GE
gemma 3 27b it qat q4 0
Gemma · google
Params27B
Context128K
Smallest17.2 GB
Vision
GE
MamayLM Gemma 2 9B IT v0.1
Gemma · INSAIT-Institute
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FA
FabGemma
Fabgemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
ER
Erax_Translator
Erax · erax-ai
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3 1b It Absolute Heresy
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 R1984 27B
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 12b Novision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing