GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
grimjim Magnolia v2 Gemma2 8k 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
EZO Gemma 2 2b Jpn It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
CA
CardProjector 27B v4
Cardprojector · SlerpE
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 Glitter 40B
Gemma · mradermacher
Params39.8B
Context128K
Q4_K_M24.3 GB
GGUF
GE
Gemma 2 27b
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma-3-4B-It
Gemma · Sci-fi-vy
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
ME
ClinicDx AudioProjector v3
Medgemma · ClinicDx1
Params12M
Context—
Smallest0.0 GB
GGUF
GE
gemma 4 e2b hexagon
Gemma · h2loop-ai
Params4.63B
Context128K
Smallest0.1 GB
ReasoningTool use
GE
TenaOS
Gemma · beza4588
Params7.52B
Context128K
Smallest15.1 GB
ReasoningTool useVision
GE
Gemma 3 1b Pt
Gemma · skymizer
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma-2-27b-it
Gemma · Dracones
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · xing1217
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 3 4b It
Gemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
Vision
MI
Mira v1.1 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
AT
Atlas Chat 27B
Atlas · DevQuasar-3
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
eliza 1 2b gpt55 scenarios
Gemma · elizaos
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 3 27b It Abliterated v2
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
antonio gemma3 smart q4
Gemma · chill123
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Magot v2 Gemma2 8k 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b
Gemma · shahzeb171
Params2.61B
Context8K
Smallest1.2 GB
GGUF
GE
Luna Gemma 12B
Gemma · wayzer2321
Params11.9B
Context256K
Smallest12.7 GB
ReasoningTool use
GE
AliMaatouk/Gemma-2-2B-Tele
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DA
datagemma rag 27b it
Datagemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
google/gemma-1.1-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 31B it RAM 26GB
Gemma · baa-ai
Params30.7B
Context256K
Smallest25.8 GB
ReasoningTool use
FU
functiongemma 270m it coffee robot mcp
Functiongemma · renhehuang
Params268M
Context32K
Smallest0.5 GB
Tool use
GE
Gemma 3 4b It
Gemma · AmpereComputing
Params3.88B
Context128K
Smallest3.9 GB
Vision
GE
gemma 3 27b it abliterated Q8 K XL
Gemma · Naphula
Params27B
Context128K
Smallest6.3 GB
Vision
GE
Gemma 3 Gaia PT BR 4b it
Gemma · mrbitsdcf
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF

Keep browsing