Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 31B it qat MTP
Gemma · magnitudedev
Params470M
Context128K
Smallest0.3 GB
ReasoningTool use
GE
Gemma 4 26B A4B It
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 4 19B A4B It The DECKARD Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
CodingReasoningRoleplay
GE
Gemma 3 12b It
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 270m It Qat
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
gemma 4 E4B it uncensored vision
Gemma · InfinimindCreations
Params7.5B
Context128K
Smallest8.0 GB
Vision
GE
Gemma 3 12b It Jailbreak ES
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
gemma 3 4b it roleplay tuned v2
Gemma · Indexnusrefather
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
gemma-2-27b-it
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma-4-12B-it-heretic
Gemma · JMingo
Params11.9B
Context256K
Q4_K_M7.1 GB
Coding
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma The Writer N Restless Quill V2 Enhanced32 10B Uncensored
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.1 GB
Roleplay
GE
Gemma 4 21b A4B It REAP Heretic
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
Coding
GE
Gemma 2 2b Jpn It
Gemma · webbigdata
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma-3-4B-It
Gemma · zw89
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 R1 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
gemma 4 e2b it
Gemma · nile-academy
Params4.63B
Context128K
Smallest3.3 GB
Vision
GE
0pen
Gemma · 0penAGI
Params7.46B
Context128K
Smallest0.9 GB
GGUF
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Gemma 3 4b
Gemma · lmstudio-community
Params3.88B
Context128K
Smallest2.4 GB
Vision
GE
gemma 3 12b it qat q4 0
Gemma · google
Params11.8B
Context—
Smallest8.1 GB
Vision
GE
Skaldic Gemma 4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 4 26B A4B It Arli
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · ThomasBaruzier
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Ru Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 4 26B A4B it Uncensored Apex Quality
Gemma · Furude0Rika
Params25.2B
Context256K
Smallest19.7 GB
Roleplay
GE
Gemma 4 26B Roleplay v2 Merged
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · jie1888
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma4 E4B 8B Heretic Ultra
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 The Deckards Brain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplay

Keep browsing