GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · mrmage
Params2.61B
Context8K
Smallest1.5 GB
GGUF
GE
Gemma 3 1b Arabic Gec v1
Gemma · echos-keeper
Params1B
Context32K
Smallest0.9 GB
GGUF
GE
gemma 3 1b aliberated
Gemma · Trey2016
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SJ
SJT 2B i1
Sjt · mradermacher
Params2.61B
Context128K
Q4_K_M1.7 GB
GGUF
MI
Mira v1.9 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Google.Gemma 2 2b Jpn It
Gemma · DevQuasar-5
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
RN
Rnj 1 Instruct
Rnj · prithivMLmods
Params8.31B
Context32K
Smallest8.8 GB
Tool use
GE
gemma-3-12b-it-int4
Gemma · gaunernst
Params11.8B
Context128K
Smallest6.6 GB
Vision
GE
Gemma 2 2b It
Gemma · tgsc
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 E2B Aggressive
Gemma · VECTORVV1
Params4.65B
Context128K
Smallest3.0 GB
ReasoningTool useVision
GE
gemma 3 4b it
Gemma · Menterium
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 4 26b a4b
Gemma · Omega-Factory
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · Diangle
Params11.8B
Context128K
Smallest4.8 GB
Vision
AM
amaretto embed 148m
Amaretto · AmarettoLabs
Params153M
Context2K
Smallest0.1 GB
CodingEmbedding
GE
EZO Common T2 2B gemma 2 it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TO
Toolgrad 1b
Toolgrad · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Tool use
GE
gemma 4 2b it
Gemma · llmware
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool use
GE
Gemma 3 27b Pt Transplant
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Mlabonne Gemma 3 4b It Abliterated v2
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
Vision
GE
EZO-Common-9B-gemma-2-it
Gemma · mmnga
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SP
Spoomplesmaxx Whiskeyjack 12B
Spoomplesmaxx · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
ReasoningRoleplayTool use
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · harsh024
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · Rosexh
Params4.65B
Context128K
Smallest3.0 GB
ReasoningTool useVision
GE
Discord Gemma 1B V1 Base MERGE
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 12b It Abliterated
Gemma · matrixportalx
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · LARONofficial
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
2B
2B ad
mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · BernTheCreator
Params6.87B
Context32K
Smallest4.1 GB
Vision
GE
Gemma3 Quiet.Hours 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay

Keep browsing