GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
hina gemma4 12b balanced q4km browser
Gemma · Sido
Params11.9B
Context256K
Smallest7.4 GB
ReasoningTool use
LL
Gemma 2 Llama Swallow 9b It v0.1
Llama · mmnga
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b Pt
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
AL
Albert_Wesker 1B
Albert · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
ReasoningRoleplay
GE
Gemma Kimu 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SH
Shieldgemma 2b
Shieldgemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
FU
Google.Functiongemma 270m It
Functiongemma · DevQuasar
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
GE
Mlabonne.Gemma 3 12b It Abliterated v2
Gemma · DevQuasar
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
SP
BeaverAI Spectre 37B v1a
Spectre · ReadyArt
Params36.6B
Context256K
Smallest30.3 GB
GGUF
GE
Gemma 3 1b It Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SO
Sophia La.Sensible 2B
Sophia · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Roleplay
FU
FunctionGemma Director V1
Functiongemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
GE
Gemma 4 31B It Abliterated
Gemma · lhca521
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 3 4B THINKING
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Google.Gemma 3 4b Pt
Gemma · DevQuasar-5
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
TR
Translategemma 4b It
Translategemma · Qwe1325
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 2 2B TR Knowledge Graph i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
PA
Parasite.NE Alpha 1B
Parasite · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Gemma-4-26B-A4B-it-Heretic
Gemma · deucebucket
Params25.2B
Context256K
Smallest11.7 GB
CodingReasoningTool use
GE
INSAIT Institute.BgGPT Gemma 2 2.6B IT v1.0
Gemma · DevQuasar-3
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mira v1 Dpo 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · vladim233334
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
SA
SAEVerbalizer 27B
Saeverbalizer · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Coding
GE
Gemma 3 1b Pt
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3n E4B It Absolute Heresy
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
MI
MiLMMT 46 4B v0.1
Milmmt · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
NE
GaMS 9B Instruct Nemotron
Nemotron · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DE
Delirium v1
Delirium · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
IN
En Indic Translate 4b
Indic · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
MamayLM Gemma 3 4B IT v1.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision

Keep browsing