Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 R1984 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma4 26b a4b vn translate test
Gemma · athomeow
Params25.2B
Context256K
Smallest13.9 GB
ReasoningTool use
GE
Big-Tiger-Gemma-27B-v1
Gemma · backyardai
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
C2S Scale Gemma 2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Thai Research Gemma 3 27b It
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
Vision
GE
Gemma 2 9b It 390K
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 E2B it qat q4 0 exact
Gemma · xbill9
Params4.63B
Context128K
Smallest2.6 GB
ReasoningTool use
GE
Gemma 4 E4B It Dspark
Gemma · rasyosef
Params547M
Context128K
Smallest0.6 GB
ReasoningTool use
GE
Tiger Gemma 9B V2 i1
Gemma · BasedAGI
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 270m it loom
Gemma · loom-ai-org
Params268M
Context—
Smallest1.1 GB
GGUF
GE
Gemma 4 E2B it qat abliterated UD Q4 K XL
Gemma · RemySkye
Params4.63B
Context128K
Smallest2.6 GB
ReasoningTool useVision
GE
Amoral Gemma3 12B v2 Qat
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Tiger Gemma 9B v3 imatrix
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Gen4_gemma 3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
studyapp writer
Gemma · DoctorPuppy
Params4.63B
Context128K
Smallest3.4 GB
ReasoningTool use
GE
Gemma 3 27b Experiment Storyteller
Gemma · SaisExperiments
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · Acelogicdev
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
turkish gemma9b v0 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Tiger Gemma 9B v2
Gemma · TheDrummer
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Cunt1257
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
GE
gemma2 9b it for tripadvisor v4 10 samples
Gemma · hienbm
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 31B StyleTune
Gemma · dexgeh
Params32.1B
Context256K
Smallest20.1 GB
ReasoningTool use
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.8 GB
GGUF
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · Jackxuanxuan
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningRoleplay
GE
google-gemma-2b-it-dequantized
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 E2B DSL r64 a2 lr6e 05 constant with warmup ep1 full dataset bf16
Gemma · danokus
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
GE
gemma-4-E2B-it-qat-mobile
Gemma · MonsieurTapir
Params5.03B
Context128K
Smallest1.9 GB
ReasoningTool use
GE
Gemma-4-E2B-It
Gemma · ALexJM19
Params4.65B
Context128K
Q4_K_M3.1 GB
ReasoningTool useVision

Keep browsing