GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MT2 Gen4 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma2 gutenberg 27B
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
ON
Oni_Mitsubishi_12B_Vision
Oni · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 12b It Heretic v2
Gemma · ZHANGYONG054
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GE
Turkish Gemma 2 9B IT
Gemma · mehmettozlu
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
chyon gemma 4
Gemma · arabellako22
Params4.65B
Context128K
Q4_K_M3.4 GB
Reasoning
GE
Heretic
Gemma · nguyenthilaitrieulong
Params30.7B
Context256K
Smallest35.0 GB
CodingReasoningTool use
GE
Zhaav Gemma3 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · angelwind
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 3 27b It
Gemma · thataigod
Params27B
Context128K
Smallest14.5 GB
Vision
ME
medgemma 4b
Medgemma · wredd
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
VI
Vikras 1 to 3b collection
Vikras · srs6901
Params2.03B
Context32K
Smallest1.1 GB
ReasoningTool use
GE
Google_Gemma 3 4b It
Gemma · kolosal
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 3 1b it
Gemma · nhay103
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
AL
Albert_Wesker 1B
Albert · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
ReasoningRoleplay
HE
Heretic.Erudite_v2 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
AN
anthracite org magnum v4 27b
Anthracite · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
MT Gen7 gemma 2 9B
Gemma · MaziyarPanahi
Params9.24B
Context8K
Smallest6.5 GB
GGUF
GE
atom v1 preview 12b
Gemma · vanta-research
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
gemma 3 27b fujin
Gemma · ArtusDev
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3n E4B It
Gemma · Edge-Quant
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
CO
Codegemma 1.1 2b
Codegemma · LiteLLMs
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 3 12b It Abliterated
Gemma · wqerrewetw
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
DA
Darkness Incarnate 12B v1
Darkness · ReadyArt
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
CO
Codegemma 7b It
Codegemma · bms22
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · oncu
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma4 E4B Function Calling xLAM Unsloth
Gemma · ermiaazarkhalili
Params7.52B
Context128K
Q4_K_M5.3 GB
Tool use
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · FunctionZero
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · lucKYQC1
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
TR
Translategemma 27b It
Translategemma · yeoj34760
Params27B
Context128K
Q4_K_M16.5 GB
Vision

Keep browsing