Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
gemma-2b
Gemma · hoangton
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
GE
gemma 4 E2B abliterated btx
Gemma · RAFABTX
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Rinna.Gemma 2 Baku 2b
Gemma · DevQuasar-10
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 26B A4B it qat
Gemma · WhiskyAKM
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 26B A4B Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · Jackxuanxuan
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningRoleplay
GE
Gemma-4-E4B-It
Gemma · ktruestory
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision
GE
RavenX OpenFable Coderagent gemma 4 12B coder fable5 composer Soulinfused Remastered
Gemma · deadbydawn101
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
OpenLongCoT Base Gemma2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
MT Gen1 Gemma 3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 26B A4B It
Gemma · steampunque
Params25.2B
Context256K
Smallest16.1 GB
ReasoningTool useVision
GE
Saiga_Gemma2_9B_Abliterated_Sft_M3_D9_Abliterated
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2b It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 E2B It Heretic Ara
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma3 Emotional_Uncensored V2 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma2magnum 27b i1
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma Orchid 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
GE
apocalypse aid gemma4 e2b
Gemma · DestinyApocalypse
Params4.63B
Context128K
Smallest2.6 GB
ReasoningTool useVision
GE
Hypa Gemma4 E2B v1
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Tool use
GE
Gemma 2 2b ORPO Jpn It Abliterated 18
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma 1.1 7b It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma4 E2B Claude Sonnet Distilled
Gemma · Lufel6848
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma 3 4b It Heretic Logic
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma-4-E2B-It
Gemma · fridaycandour
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision
GE
Gemma 3 4b It
Gemma · starust
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Spoomplesmaxx Gemma4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
Gemma 4 26B A4B It
Gemma · pirola
Params25.2B
Context256K
Smallest14.0 GB
ReasoningTool use
GE
Gemma 4 E4B Reasoning
Gemma · talisma
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision
GE
Gemma 4 19B A4B It INSTRUCT Heretic Uncensored
Gemma · kainah
Params18.4B
Context256K
Q4_K_M12.3 GB
CodingReasoningRoleplay
GE
Malaysian Gemma 3 27b It
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF

Keep browsing