GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
gemma-2-9b-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
LL
Gemma 2 Llama Swallow 27b Pt v0.1
Llama · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Occitan Gemma 3 4b It Dora
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Thai Legal Gemma 4B CPT
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 12B Fornax QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
MamayLM Gemma 3 12B IT v2.0
Gemma · INSAIT-Institute
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Ablation 196 Finalsft2 Shisa v2 Gemma3 27b
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
scout 4b
Gemma · vanta-research
Params3.88B
Context128K
Q4_K_M2.5 GB
ME
Medgemma3 Thinking
Medgemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2 27b Chatml
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
MA
magnum v4 9b
Magnum · anthracite-org
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 4b It Null Space Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
XV
xVITA Embed 300M zhTW
Xvita · xCloudinfo
Params308M
Context8K
Smallest0.3 GB
KO
Kordef 12b
Kordef · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
TR
Translategemma 4b It
Translategemma · prithivMLmods
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma2 Nephilim v3 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
GemmaX2 28 9B Pretrain
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
TR
Translategemma 4b It
Translategemma · anilb
Params11.8B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 12b It Abliterated Refined Novis
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 2b Aps It
Gemma · bartowski
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 21b a4b it REAP
Gemma · barozp
Params20.8B
Context256K
Q4_K_M13.8 GB
GE
Gemma 3 4b It PaperWitch Heresy
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma4_E2B_Abliterated_Opus_Distilled
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
SU
Super Slop Machina XXL v0.1 4B
Super · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 12b It
Gemma · nocturne23
Params11.8B
Context128K
Q4_K_M7.3 GB
TU
LLMBG ToolUse 2.6B v1.0
Tucan · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2 9b It Fix System Role
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 1B IT
Gemma · brittlewis12
Params1B
Context32K
Q4_K_M0.8 GB