GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
MI
Mira v1.19 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2 2B IT
Gemma · CelesteImperia
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 12B IT NVFP4 Src
Gemma · LibertAIDAI
Params11.9B
Context128K
Q4_K_M7.0 GB
SM
Smilodon 9B v1
Smilodon · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Nidum Gemma 3 4b It Uncensored
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 12B Fornax QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Google Gemma 2 27b
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · Uynaity
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3n E2B It
Gemma · mmnga
Params4.46B
Context32K
Q4_K_M2.8 GB
GE
Cycleinstruct Gemma4 Supervisor
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
mlabonne gemma 3 12b abliterated
Gemma · fwwrsd
Params11.8B
Context128K
Q4_K_M7.3 GB
BO
Borealis 12b Instruct Preview
Borealis · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
DreamFast Gemma 3 12b It Heretic v2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
JU
Jungle Oasis BRF MPOA 9B
Jungle · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Magnolia v2 Gemma2 8k 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
nbeerbower gemma2 gutenberg 27B
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 2 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Gemma 2 Llama Swallow 27b It v0.1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Amethyst_1_5_Mini_Fp16
Gemma · VertexAGI
Params4.55B
Context128K
Q4_K_M2.9 GB
GE
Gemma 3 4b Pt
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma3.Novaciano 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4b It Ko Reasoning
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 27b It Ko Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
SemanticRepair 270M
Gemma · Gramscii-IT
Params268M
Context32K
Smallest0.3 GB
WE
Webs Sejong 31B v7
Webs · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
SH
shieldgemma 9b
Shieldgemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-3-1B-It
Gemma · Diasol
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 2B Tele It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mimma 3 4b v3
Mimma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
SH
Shadow Siren 14B v2
Shadow · Goopr
Params13.8B
Context256K
Smallest7.8 GB