Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 4b Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3 R1 12B v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
GE
Gemma 3 27b Half Full
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma-4-E2B-It
Gemma · Straet
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
GE
Gemma 3 4b It Qat Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3 Earthen v0.2 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · jingamin
Params30.7B
Context256K
Smallest21.8 GB
ReasoningTool use
GE
Gemma 3 1b It
Gemma · tatsuyaaaaaaa
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
GemmaColRAC AeroExpertV4
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 7b Aps It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
GemmaX2 28 2B v0.2
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 12b It Uncensored
Gemma · claymorecrystal
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 4 26B A4B StyleTune
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma 3 1b It
Gemma · duyntnet
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
code il E4B
Gemma · BrainboxAI
Params7.52B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GE
Gemma 2 2b It
Gemma · dahara1
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma SEA LION v4 4B VL
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma4 31B 1bit
Gemma · arcticoneai
Params3.77B
Context—
Smallest3.8 GB
GGUF
GE
Gemma 4 26B A4B it Cerebellum v6
Gemma · deucebucket
Params25.2B
Context256K
Smallest11.7 GB
ReasoningTool useVision
GE
Gemma2 9b Cpt Sea Lionv3 Instruct
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Google.Gemma 3 27b Pt
Gemma · DevQuasar-10
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Wansi gemma 2b instruct ft apple qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 12B It
Gemma · Krasnopjorovs
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 3 1b It
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Shirdel Finance E4B
Gemma · Tesleum
Params7.52B
Context128K
Smallest6.2 GB
ReasoningTool use
GE
grimjim 12B Gemma 3 it norm preserved biprojected abliterated
Gemma · RossAscends
Params11.8B
Context128K
Smallest4.3 GB
GGUF
GE
Gemma 3 4b_X Ray Abli_Linear_v1.01
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
llm gemma4 heretic 31b q4km
Gemma · yuanyeyuanye
Params30.7B
Context256K
Smallest18.7 GB
ReasoningTool useVision
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3n E4B It
Gemma · mmnga
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF

Keep browsing