GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Danielbrdz Barcenas Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma4 social bias judge
Gemma · krishnakartik
Params7.52B
Context128K
Smallest5.8 GB
ReasoningTool use
GE
gemma-2-9b
Gemma · martintomov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CO
Codegemma 2b
Codegemma · tensorblock
Params2.51B
Context8K
Smallest1.2 GB
GGUF
GE
Gemma 4 26B A4B Heretic PRISM DQ I
Gemma · KaviarLabs
Params25.2B
Context256K
Smallest13.6 GB
CodingReasoningTool use
GE
gemma 3 270m chinese title generator
Gemma · keke0130
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · FM-1976
Params2.61B
Context8K
Smallest1.9 GB
GGUF
GE
Gemma-3N-E4B-It
Gemma · parkingsoman
Params6.87B
Context32K
Smallest4.4 GB
GGUF
GE
Gemma2 27b
Gemma · afg1
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Google Gemma 2 9b
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
FU
FunctionGemma 270M Healthcare
Functiongemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
KA
Karakuri Lm 7b Apm v0.1
Karakuri · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
GE
gemma 3 12b it qat q4 0
Gemma · vinimuchulski
Params11.8B
Context128K
Smallest8.1 GB
Vision
CO
Codegemma 7b It
Codegemma · sheldonrobinson
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma Kimu 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GL
Glimpse v1
Glimpse · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
lemon-mint/gemma-2b-translation-v0.91
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · SSBOfficial
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 2 2b It
Gemma · ZT6000
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
clement mk gemma 12b
Gemma · MartinV
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
UN
Unicorn Legendary_Merge 1B
Unicorn · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Nidum Gemma 2B Uncensored
Gemma · PJRM
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 2B it Finance Aspect Based Sentiment Analyzer
Gemma · snrspeaks
Params2.51B
Context8K
Smallest2.7 GB
GGUF
GE
google/gemma-2-2b
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MA
magnum v4 9b
Magnum · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
google gemma 3 27b it qat q4 0 gguf fix
Gemma · jaxchang
Params27B
Context128K
Smallest15.6 GB
Vision
GE
Gemma 3n E2B It
Gemma · Edge-Quant
Params4.46B
Context32K
Q4_K_M2.8 GB
Vision
FU
ai mod create 270smol
Functiongemma · sjdthree
Params268M
Context32K
Smallest0.3 GB
Tool use
GE
Gemma 3 12b It
Gemma · NikolayKozloff
Params11.8B
Context128K
Smallest12.5 GB
Vision
GE
Gemma 3 4b It
Gemma · DravenBlack
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision

Keep browsing