GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Gemma 3 4b It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma SEA LION v3 9B IT
Gemma · aisingapore
Params9.24B
Context8K
Q4_K_M5.8 GB
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
Gemma4 12B Uncensored HauhauCS 1.5M
Gemma · satgeze
Params11.9B
Context256K
Smallest0.3 GB
MI
Mira v1.7 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 4 26B A4B it abliterated
Gemma · Vastopian
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
CyberNeurova Gemma 4 26B A4B
Gemma · cyberneurova
Params25.2B
Context256K
Q4_K_M16.8 GB
CO
codegemma-1.1-7b-it
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 3 12b It Orthogonal Reflection Bounded Ablation v4 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GW
GWQ 9B Preview
Gwq · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v1 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GR
grabbe ai
Grabbe · grabbe-gymnasium-detmold
Params9.24B
Context8K
Q4_K_M5.8 GB
TE
Tema_Q R7.0
Tema · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma4 E4B Mahou Nsfw
Gemma · claymorecrystal
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma3 27b Abliterated Dpo
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SH
Shieldgemma 9b
Shieldgemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 7b aps it
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
FA
FabGemma
Fabgemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
BO
Borealis Open 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
BO
Boulesis 26B A4B
Boulesis · spiritfather
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 2 2b It
Gemma · second-state
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma4 Gutenberg 26B A4B i1
Gemma · spiritfather
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Unrestricted
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 12b It Jailbreak EN
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 19B
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
KA
KatipGPT Base
Katipgpt · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-3-4B-It
Gemma · tripolskypetr
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
DiscoPOP zephyr 7b gemma
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
NE
GaMS 27B Instruct Nemotron
Nemotron · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3 27B Derestricted
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB