GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MamayLM Gemma 3 27B IT v2.0
Gemma · INSAIT-Institute
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3n E2B It
Gemma · shreyashmakadia
Params4.46B
Context32K
Q4_K_M3.3 GB
Vision
GE
Gemma 3 12b It Projection Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
TE
Tema_Q X
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 40b
Gemma · bartowski
Params39.8B
Context128K
Q4_K_M24.3 GB
GGUF
GE
Gemma 2 Baku 2b It
Gemma · MCZK
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 E4B It Assistant
Gemma · matrixportalx
Params78M
Context128K
Smallest0.1 GB
GGUF
GE
Gemma 3 270m It
Gemma · lmstudio-community
Params268M
Context32K
Smallest0.2 GB
GGUF
GE
Gemma 3 27b Pt BeyondReality
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
MTMMe Merge gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 7b It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 4 19b a4b it REAP
Gemma · barozp
Params18.4B
Context256K
Q4_K_M12.3 GB
ReasoningTool useVision
GE
Aidc Llm Laos 10k Gemma 3 12b It
Gemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma 3 1b It Abliterated
Gemma · matrixportalx
Params1B
Context32K
Q4_K_M0.8 GB
Vision
CO
models--google--codegemma-7b-it
Codegemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 3 12b Pt
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
BO
Borealis Open 1b
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma-3-1B-It
Gemma · tripolskypetr
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 4 E4B Luchador
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
GE
Gemma 3 27b It Abliterated Normpreserve v1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
EZO2.5 Gemma 3 12b It Preview
Gemma · mmnga
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 12b It Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 2 27b
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ER
Erebus RP 12B Instruct 2608 v1
Erebus · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
BO
Borealis Open 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 1b It Heretic
Gemma · saidutta69
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
BI
Bifrost-27B-GGUF
Bifrost · Joumdane
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 4b It RP v0.1
Gemma · Aratako
Params4.55B
Context128K
Q4_K_M2.9 GB
Roleplay
GE
Gemma 3 12b It Abliterated v2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
gemma 3 4b it null space abliterated
Gemma · jwest33
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision

Keep browsing