GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma-2-9b-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Gemma 2 Llama Swallow 27b Pt v0.1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Occitan Gemma 3 4b It Dora
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Thai Legal Gemma 4B CPT
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 3 12B Fornax QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningRoleplay
GE
MamayLM Gemma 3 12B IT v2.0
Gemma · INSAIT-Institute
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Ablation 196 Finalsft2 Shisa v2 Gemma3 27b
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Roleplay
GE
scout 4b
Gemma · vanta-research
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplayVision
ME
Medgemma3 Thinking
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
GE
Gemma 2 27b Chatml
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MA
magnum v4 9b
Magnum · anthracite-org
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4b It Null Space Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
XV
xVITA Embed 300M zhTW
Xvita · xCloudinfo
Params308M
Context8K
Smallest0.3 GB
Embedding
KO
Kordef 12b
Kordef · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
TR
Translategemma 4b It
Translategemma · prithivMLmods
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma2 Nephilim v3 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
GemmaX2 28 9B Pretrain
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TR
Translategemma 4b It
Translategemma · anilb
Params11.8B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3 12b It Abliterated Refined Novis
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2b Aps It
Gemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 21b a4b it REAP
Gemma · barozp
Params20.8B
Context256K
Q4_K_M13.8 GB
ReasoningTool useVision
GE
Gemma 3 4b It PaperWitch Heresy
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma4_E2B_Abliterated_Opus_Distilled
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
SU
Super Slop Machina XXL v0.1 4B
Super · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
GE
Gemma 3 12b It
Gemma · nocturne23
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
TU
LLMBG ToolUse 2.6B v1.0
Tucan · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Tool use
GE
Gemma 2 9b It Fix System Role
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1B IT
Gemma · brittlewis12
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning

Keep browsing