GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Kitsunebi v1 Gemma2 8k 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Super Slop Machina XXL v0.1 4B
Gemma · Indexnusrefather
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
Gemma 3 27b It
Gemma · gaianet
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
typhoon2.1 gemma3 4b i1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningTool use
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 R1984 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Thai Research Gemma 3 27b It
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
Vision
ST
StructuredGemma 3 270M
Structuredgemma · mradermacher
Params436M
Context32K
Q4_K_M0.4 GB
Reasoning
GA
GaMS3 12B Instruct
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
OP
Openwebui Title Generator 270m
Openwebui · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
TU
Tucan 2.6B v1.0
Tucan · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Tool use
GE
MT Gen4_gemma 3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 27b Experiment Storyteller
Gemma · SaisExperiments
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Cunt1257
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
GE
gemma2 9b it for tripadvisor v4 10 samples
Gemma · hienbm
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
BO
Borealis Open 4b
Borealis · NbAiLab
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.8 GB
GGUF
LU
Lumko Medgemma 4b
Lumko · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
CO
google/codegemma-2b
Codegemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
FI
Fixed_Sana
Fixed · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BO
Boulesis v2 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma 7b Aps It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GA
Gama 12b
Gama · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 2 2b Jpn It
Gemma · alfredplpl
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TU
s-emanuilov/Tucan-2.6B-v1.0
Tucan · llm-bg
Params2.61B
Context8K
Q4_K_M1.7 GB
Tool use
TU
Tucan 9B v1.0
Tucan · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Tool use
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · ATOMIKMN
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma2 2b
Gemma · afg1
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mira v1.11 Ties 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 4b It Roleplay Tuned v1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay

Keep browsing