GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
magnum v3 9b chatml
Gemma · anthracite-org
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Google Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
MiLMMT 46 4B v0.1
Milmmt · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
ER
Erudite V2 1b
Erudite · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LL
Gemma 2 9B Instruct
Llama · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Ada Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GA
GaMS3 12B
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma4 E2B It Disinhibited
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
gemma 2 2b jpn it abliterated 18 i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GO
google datagemma rag 27b it
Google · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
AM
Amethyst 1 Mini
Amethyst · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
GE
EZO Gemma 2 2b Jpn It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
GemCod Codegen 270M
Gemcod · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Coding
MI
MiLMMT 46 1B v0.1
Milmmt · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Gemma 3 1b Pt
Gemma · ggml-org
Params1B
Context32K
Smallest2.0 GB
GGUF
GE
Gemma 2 9b It
Gemma · dahara1
Params9.24B
Context8K
Q4_K_M6.8 GB
GGUF
GE
google/gemma-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma3 1B
Gemma · pjh64
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
MI
Mira v1.2 Dpo 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
CodingVision
GE
Unsloth Gemma 3 1b It
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
GGUF
GE
gemma2 9b cpt sea lionv3 instruct
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
HE
Heretic.Erudite_v2 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GGUF
GE
MT5 Max Merge 02012025163610 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 E2B vaccine xai merged qat
Gemma · hung2903
Params4.63B
Context128K
Smallest3.3 GB
ReasoningVision
LL
Gemma 2 2B
Llama · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 31B It Assistant
Gemma · cafkafk
Params470M
Context256K
Q4_K_M0.4 GB
GGUF
GE
Gemma 3 4b Novision
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 4b It Heretic
Gemma · SimplySara
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision

Keep browsing