Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 1b It
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 12b It Vl HighIQ Polaris Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
Gemma 4 31B It Uncensored Heretic v2
Gemma · lactroiii
Params30.7B
Context256K
Smallest25.2 GB
ReasoningTool useVision
GE
gemma-4-31B-it
Gemma · Mungert
Params30.7B
Context256K
Q4_K_M19.3 GB
Vision
GE
Gemma 4 Gembrain X Core 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
GE
Gemma 2 9b It
Gemma · DiTy
Params9.24B
Context8K
Smallest18.5 GB
Tool use
GE
Gemma 4 Gembrain 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay
GE
Huihui Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Suno Song Reasoning Generator Gemma3 12B HF
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
GE
Gemma Kimu 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 27b It Abliterated
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma4 12B Uncensored HauhauCS 1M
Gemma · satgeze
Params11.9B
Context256K
Smallest0.3 GB
Vision
GE
new adult writer
Gemma · ahmed22xa
Params7.52B
Context128K
Q4_K_M8.6 GB
RoleplayVision
GE
Gemma-4-12B-Unified-System-One
Gemma · knowlet
Params11.9B
Context256K
Smallest12.7 GB
Vision
GE
EZO Common 9B gemma 2 it
Gemma · MCZK
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 2 9b it
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 270m
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma 4 12B It
Gemma · giladgd
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Aura v1.1
Gemma · UncannyEcho
Params7.46B
Context128K
Smallest5.2 GB
Vision
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · prithivMLmods
Params25.2B
Context256K
Smallest26.9 GB
ReasoningVision
GE
Gemma 3 4B VL It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GE
Aidc 5k Laos Gemma 3 4b It v2
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
GE
Gemma 4 E4B It Qat Assistant
Gemma · Yiriru
Params78M
Context128K
Smallest0.1 GB
ReasoningTool useVision
GE
Gemma 4 E2B It Assistant
Gemma · AtomicChat
Params77M
Context128K
Q4_K_M0.1 GB
GGUF
GE
Gemma 4 12B It Guardpoint
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Reasoning
GE
Gemma 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 4 E2B It Anon Reasoning
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 4 12B It Heretic_Decensored
Gemma · prithivMLmods
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Gemma 4 Gemsicle 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay

Keep browsing