Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Frank 26B A4B GGUFs
Gemma · TendieLabs
Params25.2B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
GE
Iris 12B Gemma 4 It Qat
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma-4-31B-It
Gemma · fractaldactal
Params30.7B
Context256K
Q4_K_M18.3 GB
ReasoningTool useVision
GE
Fallen Gemma3 27B v1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 1b It
Gemma · qwp4w3hyb
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 27b It Antislop
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
gemma 3 12b it null space abliterated
Gemma · jwest33
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
models--mergekit-community--mergekit-slerp-dclolyo
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2b It SFT D1_chosen Orca
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 1.1 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Google Gemma 3 27b It Text
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
gemma2 9b cpt sahabatai v1 instruct
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MultimodalTopic 27B Gemma3 Flash
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Jokes Sft Gemma 3 12b v2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
malama aira 9b
Gemma · IhArmayau
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
hina gemma4 e4b aggressive q4km browser
Gemma · Sido
Params7.52B
Context128K
Smallest4.6 GB
ReasoningTool use
GE
Gemma SEA LION v4 27B VL
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 4 E4B It Heretic Ara
Gemma · MoonRide
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · gagarin346567
Params11.9B
Context256K
Smallest0.9 GB
ReasoningTool use
GE
VeriCoder_Gemma12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
GE
Gemma 4 31B It
Gemma · steampunque
Params30.7B
Context256K
Smallest17.6 GB
ReasoningTool useVision
GE
Gemma 2 Baku 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
PA heretic
Gemma · akpsahan
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
Gemma 3 1b It Abliterated v2
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Sapie Gemma2 9B IT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
SauerkrautLM-Gemma-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 31B it qat q4 0 assistant
Gemma · Gabriel31173
Params470M
Context256K
Smallest0.4 GB
ReasoningTool use
GE
hina gemma4 e2b aggressive iq3m browser
Gemma · Sido
Params4.65B
Context128K
Smallest3.1 GB
ReasoningTool use
GE
Gemma 4 typescript coder 12b
Gemma · MassivDash
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingVision

Keep browsing