GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
lemon-mint/gemma-2b-translation-v0.90
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
chyon gemma 4 gguf v2
Gemma · arabellako22
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
KI
Kizagan E4B Turkish Agent FunctionCalling Hermes
Kizagan · Tuguberk
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Hanu
Gemma · Vijaypathy88
Params4.65B
Context128K
Q4_K_M2.7 GB
ReasoningTool use
GE
Gemma 3 270m
Gemma · NikolayKozloff
Params268M
Context32K
Smallest0.3 GB
GGUF
TH
Think.NPC 1B
Think · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
ReasoningRoleplay
GE
Gemma 3 4b It Abliterated
Gemma · jeiku
Params3.88B
Context128K
Smallest2.4 GB
Vision
CO
Codegemma 2b
Codegemma · LiteLLMs
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
quantized codegemma 7b it
Gemma · c516a
Params7B
Context—
Q4_K_M0.0 GB
GGUF
CO
codegemma-1.1-7b-it
Codegemma · MoMonir
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
SJ
SJT 2.5B i1
Sjt · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PO
PolDense-1B
Poldense · kprzyb
Params1.03B
Context8K
Smallest1.1 GB
Embedding
GE
gemma 2 baku 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Hebrew_Lyrics Gemma2_2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma4 Gutenberg Literotica 12B
Gemma · alexnt2
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
gemma 4 12B coder fable5 composer2.5 v1 GGUF etheroi
Gemma · developerjeremylive
Params11.9B
Context128K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Gemma4NPC it
Gemma · spy5er
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayVision
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · faizonly5953
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · indiansatoshi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
HE
Heretic.Erudite 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
TR
translategemma 3 12b instruct lmk
Translategemma · lm-kit
Params11.8B
Context128K
Smallest23.5 GB
Vision
GE
gemma 4 12B coder fable5 composer2.5 v1 sft
Gemma · tpls
Params11.9B
Context256K
Q4_K_M8.6 GB
CodingReasoningTool use
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 31b it IQ2 M
Gemma · KikoCis
Params30.7B
Context256K
Smallest10.9 GB
ReasoningTool use
GE
Gemma 3 27b It
Gemma · gghfez
Params27B
Context128K
Smallest15.6 GB
GGUF
GA
GaMS 2B Instruct
Gams · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
EM
amem embeddinggemma r1
Embeddinggemma · KiyoZVS
Params308M
Context2K
Smallest0.3 GB
EmbeddingReasoning
ON
Oni_Mitsubishi_12B_Vision
Oni · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
BgGPT Gemma 3 27B IT V2 GGUF mmproj
Gemma · beleata74
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
gemma-1.1-7b-it
Gemma · qwp4w3hyb
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF

Keep browsing