Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Tiger-Gemma-9B-v1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
ClickBook Gemma 4 E2B multi IQ4 XS
Gemma · Clickbook
Params4.33B
Context128K
Smallest1.8 GB
ReasoningTool use
GE
goodmeet gemma 4 E2B live summary BF16
Gemma · bretdabaker
Params4.63B
Context128K
Smallest9.3 GB
ReasoningTool use
GE
gemma 4 12B coder fable5 composer2.5
Gemma · sakamakismile
Params11.9B
Context128K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Gemma 3n E4B It Abliterated
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
gemma 4 12B it qat assistant MTP Q4 0
Gemma · ysong21
Params423M
Context256K
Smallest0.3 GB
ReasoningTool use
GE
IndicTrans3 Gemma Beta
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
GE
Gemma 4 12B StyleTune QAT
Gemma · alexisStacksCode
Params11.9B
Context256K
Smallest0.3 GB
Vision
GE
Gemma Ataraxy Dare 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E4B It Uncensored
Gemma · ccharnkij
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningVision
GE
Gemma 3 Starshine 12B Alt
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 31B Mergemaxxed
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Gemma 4 12B It Esper4FableComposer
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 9B Base i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 31B storymaxxed2
Gemma · MRockatansky
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
GrayLine Gemma3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
heretic_Gemma 3 R1 4B v1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
gemma-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 E4B It Uncensored MAX Opus 4.7
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
gemma-1.1-2b-it
Gemma · second-state
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 2 27b It Abliterated
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
alpindale gemma 2b it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma ko 7b it v0.41 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 3 4b It Abliterated v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma2 Alicia 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma3 12b Tolkien_V2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma-4-E2B-it
Gemma · sphaela
Params4.65B
Context128K
Q4_K_M3.3 GB
ReasoningTool useVision
GE
Spintax Generation Gemma 3 27b
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemuma Gemma 4 E4B
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use

Keep browsing