GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
google_gemma-3-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3n E4B It PaperWitch Heresy
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Google.Gemma 3 4b It Qat Int4 Unquantized
Gemma · DevQuasar-12
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma-3-12B-It
Gemma · Abc7347
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
BO
Borealis Open 1b
Borealis · NbAiLab
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 4 26B A4B it abliterated Q4 0
Gemma · voidsip
Params25.2B
Context256K
Smallest14.4 GB
ReasoningTool use
PS
Psychosis 9B v1
Psychosis · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
GE
Gemma 2 2B Opus Instruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DA
Darkest muse v1 abliterated i1
Darkest · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
UN
Unbound v1.12.0 27B
Unbound · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
CodingVision
GE
Google_Gemma_2_9b_it
Gemma · Nexesenex
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
OM
Omni 31B Turkish Reasoning Model
Omni · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
GE
Delirium v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KE
Keural Orbit v1.0
Keural · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma 3 27b It Ultra Heretic
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
SH
shieldgemma 2b
Shieldgemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma2 gutenberg 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-3-4B-It
Gemma · Abc7347
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
EZO Common 9B gemma 2 it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 2 9b it SimPO rudpo
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
EZO Gemma 2 2b Jpn It
Gemma · MCZK
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Huihui Gemma 3n E2B It Abliterated
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
BO
Boulesis 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma 3 27b It Abliterated Refined Novis
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 12B FornaxV.2 QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningRoleplay
GE
Gemma 3 4b Mongolian
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
RA
X Ray_Alpha
Ray · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 12b It Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 3n E4B It Absolute Heresy
Gemma · MuXodious
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Gemma 2 9b It
Gemma · ThomasBaruzier
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing