GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TR
Translategemma 27b It
Translategemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b It Abliterated
Gemma · mlabonne
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
TR
Translategemma 4b It
Translategemma · SandLogicTechnologies
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 2 27b It
Gemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma 4 E2B It Heretic v1
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
Vision
GE
Gemma 3 4b It Abliterated
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
FU
Functiongemma-270M-It
Functiongemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 3 4b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params3.88B
Context128K
Smallest2.5 GB
Vision
OR
Orion Kitchoon 26B A4B
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
NO
2B_or_not_2B
Not · mradermacher
Params2.5B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 3 27b It
Gemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 4 26B A4B It Uncensored
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
BgGPT Gemma 3 27B IT
Gemma · INSAIT-Institute
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 12b It Heretic
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
ME
Merousis 26B A4B
Merousis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
GGUF
MI
MiLMMT 46 12B v1.0
Milmmt · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
KI
Kitchoon 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma-3-27B-It-Qat
Gemma · unsloth
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It Abliterated
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
gemma 3 4b it qat q4 0
Gemma · google
Params3.88B
Context—
Smallest3.2 GB
Vision
BO
Borealis Open 27b
Borealis · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 270m Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB
GGUF

Keep browsing