GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
Mira v1.19 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2 2B IT
Gemma · CelesteImperia
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 12B IT NVFP4 Src
Gemma · LibertAIDAI
Params11.9B
Context128K
Q4_K_M7.0 GB
ReasoningTool use
SM
Smilodon 9B v1
Smilodon · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Nidum Gemma 3 4b It Uncensored
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 12B Fornax QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningRoleplayVision
GE
Google Gemma 2 27b
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · Uynaity
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3n E2B It
Gemma · mmnga
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
GE
Cycleinstruct Gemma4 Supervisor
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
mlabonne gemma 3 12b abliterated
Gemma · fwwrsd
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
BO
Borealis 12b Instruct Preview
Borealis · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
GE
DreamFast Gemma 3 12b It Heretic v2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
JU
Jungle Oasis BRF MPOA 9B
Jungle · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
GE
Magnolia v2 Gemma2 8k 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
nbeerbower gemma2 gutenberg 27B
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Gemma 2 Llama Swallow 27b It v0.1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Amethyst_1_5_Mini_Fp16
Gemma · VertexAGI
Params4.55B
Context128K
Q4_K_M2.9 GB
Tool useVision
GE
Gemma 3 4b Pt
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma3.Novaciano 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Gemma 3 4b It Ko Reasoning
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Gemma 3 27b It Ko Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
GE
SemanticRepair 270M
Gemma · Gramscii-IT
Params268M
Context32K
Smallest0.3 GB
GGUF
WE
Webs Sejong 31B v7
Webs · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
SH
shieldgemma 9b
Shieldgemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-3-1B-It
Gemma · Diasol
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2B Tele It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mimma 3 4b v3
Mimma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SH
Shadow Siren 14B v2
Shadow · Goopr
Params13.8B
Context256K
Smallest7.8 GB
ReasoningRoleplayTool use

Keep browsing