GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
INSAIT Institute BgGPT Gemma 2 9B IT v1.0
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
Gemma 3 12b It Orthogonal Reflection Bounded Ablation v3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Urielg92
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Heretic_Fusion Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma3 Heretic.Nexus 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
KA
Karakuri Lm 7b Apm v0.1
Karakuri · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
lemon-mint/gemma-2b-translation-v0.120
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 2 Ifable 9B Uncensored DeLMAT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FR
FrenchGemma 3 4B Instruct
Frenchgemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
BO
Borealis 1b Instruct Preview
Borealis · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
MA
Makandal Multiple v2
Makandal · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Tool use
GE
gemma 2 9b neogenesis ita
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Embedding
GE
EZO Common T2 2B Gemma 2 It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Huihui Ai Gemma 3 1b It Abliterated
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · laladream
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 3 270m It
Gemma · gaianet
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · zyyzn2jl
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · NullAFGG
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
CA
CardProjector 27B v4
Cardprojector · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
RoleplayVision
GE
R01 Gemma 3 1b It
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 3 270m it JSON Fixer
Gemma · kth8
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
EZO Common T2 2B Gemma 2 It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SO
Sorachio 1B Chat
Sorachio · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
AL
Alexia.v2 1B
Alexia · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SJ
SJT 2B V1.1 i1
Sjt · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mira v1.25.1 27B DPO
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Tool use
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v2 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 2B Arabic mobile
Gemma · dispatchAI
Params2.51B
Context8K
Smallest1.6 GB
GGUF
GE
Gemma 3 12b It Heretic v2
Gemma · 1111214WFA
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GE
Gemma4 31B Uncensored GP100
Gemma · fallentree
Params30.7B
Context128K
Smallest0.3 GB
ReasoningTool use

Keep browsing