GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
google_gemma-3-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3n E4B It PaperWitch Heresy
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
Google.Gemma 3 4b It Qat Int4 Unquantized
Gemma · DevQuasar-12
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma-3-12B-It
Gemma · Abc7347
Params11.8B
Context128K
Q4_K_M7.3 GB
BO
Borealis Open 1b
Borealis · NbAiLab
Params1B
Context32K
Q4_K_M0.8 GB
GE
gemma 4 26B A4B it abliterated Q4 0
Gemma · voidsip
Params25.2B
Context256K
Smallest14.4 GB
PS
Psychosis 9B v1
Psychosis · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2B Opus Instruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
DA
Darkest muse v1 abliterated i1
Darkest · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
UN
Unbound v1.12.0 27B
Unbound · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Google_Gemma_2_9b_it
Gemma · Nexesenex
Params9.24B
Context8K
Q4_K_M5.8 GB
OM
Omni 31B Turkish Reasoning Model
Omni · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Delirium v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
KE
Keural Orbit v1.0
Keural · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 27b It Ultra Heretic
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SH
shieldgemma 2b
Shieldgemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma2 gutenberg 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-3-4B-It
Gemma · Abc7347
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
EZO Common 9B gemma 2 it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 2 9b it SimPO rudpo
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
EZO Gemma 2 2b Jpn It
Gemma · MCZK
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Huihui Gemma 3n E2B It Abliterated
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
BO
Boulesis 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 3 27b It Abliterated Refined Novis
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 12B FornaxV.2 QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 4b Mongolian
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
RA
X Ray_Alpha
Ray · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 12b It Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 3n E4B It Absolute Heresy
Gemma · MuXodious
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
Gemma 2 9b It
Gemma · ThomasBaruzier
Params9.24B
Context8K
Q4_K_M5.8 GB