GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
TR
Translategemma 27b It
Translategemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 27b It Abliterated
Gemma · mlabonne
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
TR
Translategemma 4b It
Translategemma · SandLogicTechnologies
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 2 27b It
Gemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E2B It Heretic v1
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 3 4b It Abliterated
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
FU
Functiongemma-270M-It
Functiongemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 3 4b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params3.88B
Context128K
Smallest2.5 GB
OR
Orion Kitchoon 26B A4B
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
NO
2B_or_not_2B
Not · mradermacher
Params2.5B
Context8K
Q4_K_M1.6 GB
GE
Gemma 3 27b It
Gemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 4 26B A4B It Uncensored
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
BgGPT Gemma 3 27B IT
Gemma · INSAIT-Institute
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 12b It Heretic
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
ME
Merousis 26B A4B
Merousis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
KI
Kitchoon 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma-3-27B-It-Qat
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 27b It Abliterated
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 3 4b it qat q4 0
Gemma · google
Params3.88B
Context—
Smallest3.2 GB
BO
Borealis Open 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 270m Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB