GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-3-1B-It
Gemma · shehrozrafaqat
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
DA
datagemma rag 27b it i1
Datagemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 2b Jpn It Abliterated 18
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma2 9b KuwaNovelist v4 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DA
datagemma rag 27b it
Datagemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 12b It MPOAdd v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma 2b
Gemma · nold
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 2b aps it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
HE
Heretic Rp Vision 31b
Heretic · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
SA
Safeword Casual V1 12B
Safeword · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
Gemma 4 21b A4B It REAP Heretic
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
CodingReasoningTool use
GE
Gemma 3 JP EN Translator v1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Locus Gemma 4 E2B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
GemmaTranslate v3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
AT
Atom 27b
Atom · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
ReasoningRoleplay
GE
The Omega Abomination Gemma3 12B v1.0
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
Gemma 1.1 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma3 27b Abliterated Dpo
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
MT gemma 4 8B E4B
Gemma · zelk12
Params7.52B
Context128K
Smallest6.2 GB
ReasoningTool useVision
GE
Ko Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
AP
Apollo2 9B
Apollo · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b Pt LucyV1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
silent_voice_multimodal_model
Gemma · 0xroyce
Params6.87B
Context32K
Smallest7.3 GB
GGUF
SH
Shieldgemma 2 4b It
Shieldgemma · infil00p
Params3.88B
Context8K
Q4_K_M2.5 GB
Vision
MI
Mira v1.17 Karcher 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Ko Gemma 2 9b It
Gemma · KIST-robot-intelligence
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Qat Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing