GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced
Gemma · danilburger123
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
GE
Google.Gemma 3 12b Pt
Gemma · DevQuasar-10
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma SEA LION v3 9B IT Cebuano
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TY
PE Type 3 Nova 4B
Type · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
BA
Barcenas 4b
Barcenas · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3 27b It Ko Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
ReasoningVision
TO
Toolgrad 4b
Toolgrad · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Tool useVision
GE
Gemma 3n E4B It Less Heretic
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemma SEA Guard 12B 2602
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced
Gemma · SSDD145
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
PA
paligemma-3b-mix-224
Paligemma · abetlen
Params2.51B
Context8K
Q4_K_M1.6 GB
Vision
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
TE
Tema_Q R 4B
Tema · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GL
Glitter Boy 12b
Glitter · ChonkE
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
GE
MT5 Max Merge 02012025163610 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Magot v2 Gemma2 8k 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SI
SILMA Kashif 2B Instruct v1.0
Silma · mradermacher
Params2.61B
Context12K
Q4_K_M1.7 GB
GGUF
GE
Gemma-3N-E2B-It
Gemma · Andre2015
Params4.46B
Context32K
Q4_K_M3.0 GB
Vision
MI
Mira v1.25.1 27B DPO
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Tool use
GE
Gemma 4 21B
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
ReasoningTool use
GE
Gemma 3 12b It Qat Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
EM
Embeddinggemma 300m
Embeddinggemma · lm-kit
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
TR
Translategemma 4b It
Translategemma · wzshiming
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SE
Sexual.Predator 1B
Sexual · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
SY
SystemGemma2 2b It
Systemgemma · RichardErkhov
Params2.61B
Context32K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2b Aps It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma SEA LION v4 4B VL
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
EZO gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BO
Boulesis 26B A4B
Boulesis · spiritfather
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningTool use

Keep browsing