GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 26B A4B It Abliterated
Gemma · SevenOfNine
Params25.2B
Context256K
Smallest19.1 GB
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma4 26B A4B Uncensored HauhauCS 1M
Gemma · satgeze
Params25.2B
Context1024K
Q4_K_M16.8 GB
MA
magnum v3 9b chatml
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2b It
Gemma · lmstudio-community
Params2.61B
Context8K
Q4_K_M1.7 GB
SH
Shieldgemma 2b
Shieldgemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
TR
Translategemma 27b It
Translategemma · bullerwins
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 270m It
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GE
gemma-2-27b-it
Gemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
EM
Embeddinggemma 300M Qat Q4_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
GE
Gemma 3 27b
Gemma · lmstudio-community
Params27B
Context128K
Smallest15.6 GB
GE
Gemmasutra Mini 2B v1
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemmuguinho 636m
Gemmuguinho · Papuguinho
Params636M
Context32K
Q4_K_M0.5 GB
BO
Borealis Open 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 27b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params27B
Context128K
Smallest15.9 GB
GE
gemma 2 it
Gemma · unsloth
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 E2B Conversational Uncensored
Gemma · minas2025
Params4.65B
Context128K
Smallest5.0 GB
JA
JapanRailwayLLM
Japanrailwayllm · mradermacher
Params9.2B
Context8K
Q4_K_M5.8 GB
MA
magnum v4 27b
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3 4b It Abliterated v2
Gemma · mlabonne
Params3.88B
Context128K
Q4_K_M2.5 GB
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 2 2b It
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 12b It Qat
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
SARC Taigi LLM 12b
Gemma · Speech-AI-Research-Center
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 2 Ataraxy 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-3-12B-It-Qat-Int4
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 2 27b it abliterated
Gemma · QuantFactory
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3 1b It Qat
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4B it Uncensored
Gemma · lemuralabs
Params3.88B
Context128K
Smallest1.2 GB
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params11.8B
Context128K
Smallest7.1 GB