GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 E4B It
Gemma · san27079
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 3 Gaia PT BR 4b It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
JapanRailwaysimLLM
Gemma · galakenya
Params—
Context—
Smallest0.0 GB
GGUF
GE
Amoral Gemma3 12B Vision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
MI
Mira 1.10 Dpo 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
gemma 4 12B coder fable5 composer2.5
Gemma · sakamakismile
Params11.9B
Context128K
Q4_K_M7.4 GB
CodingReasoningTool use
BO
Borealis Open 27b
Borealis · NbAiLab
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SI
SimplyAI 2B Uncensored i1
Simplyai · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
ER
EraX Translator V1.0
Erax · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
LL
Gemma 2 9B
Llama · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-1.1-2b-it
Gemma · second-state
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
MI
Mira v1.24.2 27B Karcher
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Tool useVision
GE
Gemma 2 27b It Abliterated
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LU
Luna 27B v0
Luna · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Roleplay
GE
Gemma 3 4b It Abliterated v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
MI
Mira v1.19.2 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
SP
Spoomplesmaxx Whiskeyjack 12B
Spoomplesmaxx · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
ReasoningRoleplayTool use
GE
google gemma 3 27b it qat q4 0 gguf small
Gemma · stduhpf
Params27B
Context128K
Smallest15.6 GB
Vision
CL
Clemma E4B
Clemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningVision
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
FU
functiongemma-270m-it
Functiongemma · Mungert
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
GE
Saiga_Gemma3_12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Google Gemma 3 27b It Text
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
gemma 7b openhermes v0.80 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
MI
Mira v1.16 Ties 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
google gemma 3 1b it qat q4 0 gguf small
Gemma · stduhpf
Params1B
Context32K
Smallest0.7 GB
GGUF
SM
Smilodon 9B v0.5
Smilodon · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KA
Kanimus 26B A4B FFT Heretic
Kanimus · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
google_gemma-3-12b-it
Gemma · Mungert
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
ganda gemma 1b
Gemma · CraneAILabs
Params1B
Context32K
Q4_K_M0.8 GB
GGUF

Keep browsing