Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma3 12b Tolkien
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 E2B Alignment Study
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
gemma 4 E2B it crap 1.1
Gemma · matthewhaynesonline
Params4.63B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
GE
Gemma 4 E4B It 2 Heretic
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Amoral Gemma3 12B Vision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 2 9b It SimPO
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-26B-A4B-It-QAT-Uncensored
Gemma · JMingo
Params25.2B
Context256K
Smallest14.3 GB
ReasoningTool use
GE
Gemma 3 4b It
Gemma · gsxrchris
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma3 9b It Girl v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma3 1B Tools
Gemma · iromu
Params1B
Context32K
Q4_K_M0.8 GB
Tool use
GE
Gemma 4 21b A4B It REAP
Gemma · Ayodele01
Params20.8B
Context256K
Q4_K_M13.8 GB
ReasoningTool use
GE
Gemma4 31b Anthology
Gemma · MRockatansky
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma Judge Preferences v0.1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma-4-E2B-It
Gemma · pingappslab
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool use
GE
PopiT Gemma 3 12B Medical SFT 1218
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma2 9b WangchanLIONv2 instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
IsoC Gemma 3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
google-gemma-2b-dequantized
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma4 Alpaca Uncensored
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma 3n E4B It Absolute Heresy
Gemma · MuXodious
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Gemma 4 Orthia 31B
Gemma · Phil2Sat
Params32.1B
Context256K
Smallest13.4 GB
ReasoningTool use
GE
Gemma 3 4b It Roleplay Tuned v1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
Gemma4 E2B It Abliterated
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 4 E4B It
Gemma · san27079
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 3 Gaia PT BR 4b It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma4 E2B Snowfox Hf
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
JapanRailwaysimLLM
Gemma · galakenya
Params—
Context—
Smallest0.0 GB
GGUF
GE
Gemma 4 26B A4B Plainspeak SOMPOA
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
Amoral Gemma3 12B Vision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision

Keep browsing