GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 31B it ROCmFP4
Gemma · kingjones777
Params30.7B
Context256K
Smallest0.5 GB
ReasoningTool useVision
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
Reasoning
GE
glimpse v1
Gemma · llmvision
Params3.88B
Context128K
Smallest4.1 GB
Vision
MI
Mimma 3 4b
Mimma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SU
G2 9B Sugarquill v0 i1
Sugarquill · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Discord Gemma 4B V1 Done
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GA
GaMS 27B
Gams · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
EZO Common T2 2B Gemma 2 It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 2 2B
Gemma · shahzeb171
Params2.51B
Context8K
Smallest1.2 GB
GGUF
MI
Mira v1.17 27B Custom Heretic
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
RA
X Ray_Alpha
Ray · oncu
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · angelwind
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · starkdcc
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma-4-E4B-SABER
Gemma · GestaltLabs
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 3 1b it tg signal extract
Gemma · Sigrex
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
VirgiF continue pretrain gemma2
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
ME
Medgemma 4b It
Medgemma · SandLogicTechnologies
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GE
Gemma 3n E4B It
Gemma · tatsuyaaaaaaa
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemmoy 9B MK.I i1
Gemmoy · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma4_E2B_Abliterated_Baked_HF_Ready
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
gemma-2-9b-it
Gemma · gaianet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gen 9B v1.1 PT exp3
Gen · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SI
SILMA Kashif 2B Instruct v1.0
Silma · mradermacher
Params2.61B
Context12K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 E2B It Assistant
Gemma · Radamanthys11
Params78M
Context128K
Smallest0.1 GB
GGUF
GE
Gemma 2 2b Jpn It Abliterated 17 ORPO
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 Ataraxy 9B
Gemma · l3utterfly
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
RE
retro 27b
Retro · AJARETRO
Params27.2B
Context8K
Smallest12.5 GB
Reasoning
FI
Firefly v5 Alpha Experimental
Firefly · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 3 270m It Heretic
Gemma · ZuzeTt
Params268M
Context32K
Q4_K_M0.3 GB
GGUF

Keep browsing