GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 A4B 98e v5 Coder It
Gemma · mradermacher
Params19.9B
Context256K
Q4_K_M13.2 GB
Coding
MI
MiLMMT 46 4B v1.0
Milmmt · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest8.4 GB
Vision
TR
Translategemma 12b It
Translategemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma2 gutenberg 27B
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 1b It
Gemma · second-state
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 2 9B It SPPO Iter3
Gemma · MCZK
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma4 12B Uncensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 4 E4B Agentic Opus Reasoning GeminiCLI
Gemma · deadbydawn101
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GE
Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced
Gemma · CCSSNE
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
TR
Translategemma 27b It
Translategemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
MA
magnum v3 9b customgemma2
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · QuantFactory
Params2.6B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Chobrr
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
AT
Atlas Chat 9B
Atlas · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 270m It Qat
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
DE
Delirium v1 i1
Delirium · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Jailbreak ES
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
TR
Translategemma 4b It
Translategemma · 42ailab
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 3 4b it roleplay tuned v2
Gemma · Indexnusrefather
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
gemma-2-27b-it
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 4 21b A4B It REAP Heretic
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
Coding
GE
Gemma-3-4B-It
Gemma · zw89
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
SH
Shieldgemma 27b
Shieldgemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
WO
WoonaV1.2 9b i1
Woonav · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4b
Gemma · lmstudio-community
Params3.88B
Context128K
Smallest2.4 GB
Vision
GE
gemma 3 12b it qat q4 0
Gemma · google
Params11.8B
Context—
Smallest8.1 GB
Vision

Keep browsing