GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 4b It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma SEA LION v3 9B IT
Gemma · aisingapore
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
YA
YanoljaNEXT Rosetta 12B 2510
Yanoljanext · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma4 12B Uncensored HauhauCS 1.5M
Gemma · satgeze
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
MI
Mira v1.7 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
gemma 4 26B A4B it abliterated
Gemma · Vastopian
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
CyberNeurova Gemma 4 26B A4B
Gemma · cyberneurova
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
CO
codegemma-1.1-7b-it
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 3 12b It Orthogonal Reflection Bounded Ablation v4 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GW
GWQ 9B Preview
Gwq · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v1 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GR
grabbe ai
Grabbe · grabbe-gymnasium-detmold
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TE
Tema_Q R7.0
Tema · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma4 E4B Mahou Nsfw
Gemma · claymorecrystal
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
GE
Gemma3 27b Abliterated Dpo
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
SH
Shieldgemma 9b
Shieldgemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 7b aps it
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
FA
FabGemma
Fabgemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
BO
Borealis Open 4b
Borealis · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
BO
Boulesis 26B A4B
Boulesis · spiritfather
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningTool use
GE
Gemma 2 2b It
Gemma · second-state
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma4 Gutenberg 26B A4B i1
Gemma · spiritfather
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Unrestricted
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 3 12b It Jailbreak EN
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 19B
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
ReasoningTool use
KA
KatipGPT Base
Katipgpt · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-3-4B-It
Gemma · tripolskypetr
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
DiscoPOP zephyr 7b gemma
Gemma · QuantFactory
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
NE
GaMS 27B Instruct Nemotron
Nemotron · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 27B Derestricted
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision

Keep browsing