GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 3 27b It Abliterated Refined Vision
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
test
Gemma · olleksi
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
INSAIT Institute_MamayLM Gemma 3 4B IT v1.0
Gemma · INSAIT-Institute
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma4 31b imatrix mtp
Gemma · pearsonkyle
Params30.7B
Context256K
Smallest0.4 GB
CodingReasoningTool use
GE
gemma-2-27b
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 4 12b RedTeam BlackICE
Gemma · ChonkE
Params11.9B
Context256K
Smallest0.5 GB
GGUF
SH
Shivneri Marathi Llm 7b v0.1
Shivneri · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
DA
Dark Goetia 26B A4B v4
Dark · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
TU
Tucan 9B v1.0
Tucan · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Tool use
GE
Gemma 3 27b It Qat Abliterated
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
saiga gemma2 10b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b It Qat Abliterated
Gemma · mlabonne
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
EP
EpistemeAI codegemma 2 9b
Epistemeai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Coding
GE
Gemma 3 27b It
Gemma · second-state
Params27B
Context128K
Q4_K_M16.5 GB
Vision
TR
Google.Translategemma 4b It
Translategemma · DevQuasar
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 12b It Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
CA
CardProjector 27B v4
Cardprojector · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Roleplay
GE
Copywriter Gemma4 31b
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
CO
codegemma-7b
Codegemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Bella Bartender Gemma E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
saiga gemma2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v2 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 4b It
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SE
SEX_ROLEPLAY 2B
Sex · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Roleplay
PA
Paligemma Chest Xray Vision
Paligemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma-2-27b-it
Gemma · second-state
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF

Keep browsing