GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
UN
Unbound v1.12.0 27B
Unbound · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Coding
GE
Gemma4 12B Uncensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
SU
SuperGemma4-31b-abliterated
Supergemma · Jiunsong
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
gemma 4 12B it TurboQuant GGUF IQ4 XS
Gemma · majentik
Params11.9B
Context256K
Smallest6.7 GB
ReasoningTool use
GE
Gemma 2 9B It SPPO Iter3
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KA
Kanimus 26B A4B FFT Heretic
Kanimus · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
CO
Codegemma 7b
Codegemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma-3-270M-It
Gemma · Sci-fi-vy
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 3 27b it ultra uncensored heretic
Gemma · llmfan46
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 4B IT
Gemma · brittlewis12
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Gemma 2 27b It Abliterated
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
RiverCub Gemma 3 27B
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It FT Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
GE
gemma 3 4B reasoning multimodal en ft v2
Gemma · CALISTA-INDUSTRY
Params3.88B
Context128K
Smallest7.8 GB
ReasoningVision
GE
vi humanizer gemma 4 e2b
Gemma · contextboxai
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Turkish Gemma 9b T1
Gemma · ytu-ce-cosmos
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E4B Heretic
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
MI
Mira v1.19 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
CA
Capybara 31B
Capybara · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningTool use
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mmnga
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Magot v3 Gemma2 8k 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12b It Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
SI
SILMA 9B Instruct v1.0
Silma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SO
Sommerfugl 31b v1
Sommerfugl · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
NO
Nori 2
Nori · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Floppa 12B Gemma3 Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 1b It
Gemma · gaianet
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Byroneverson Gemma 2 27b It Abliterated
Gemma · tensorblock
Params27.2B
Context8K
Smallest10.4 GB
GGUF
MA
Magnum v4 9b
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing