Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · DawnAppear
Params7.52B
Context128K
Smallest8.1 GB
ReasoningTool use
GE
Gemma 4 26B A4B It Ultra Uncensored Heretic
Gemma · akpsahan
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma-Wukong-2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
diallm gemma grpo all
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 26B A4B Arabic It
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
gemma 4 26B A4B it qat q4 0 Claude Opus Distill v2
Gemma · DFveloper
Params25.2B
Context256K
Smallest14.2 GB
ReasoningTool useVision
GE
Gemma 3n E4B It Absolute Heresy MPOA
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemma 3 27b Abliterated
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
gemma4 e4b arcade
Gemma · TheBioHub
Params7.46B
Context128K
Smallest6.2 GB
ReasoningTool use
GE
Gemma4 5B unfiltered
Gemma · 123Ginger321
Params4.65B
Context128K
Smallest9.3 GB
ReasoningTool use
GE
Google Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Huihui gemma 4 E2B it abliterated v2
Gemma · Momix-44
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
gemma 2b it oasst2 chatML Cluster2 aya multilingual
Gemma · dagbs
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma4 cubicasa floorplan
Gemma · rimashussain
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma3 Python 22k 1B
Gemma · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Heretic_Fusion Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Google Gemma 4 31B It
Gemma · batiai
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
BgGPT Gemma 2 27B IT v1.0
Gemma · INSAIT-Institute
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Eunoia Gemma 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b Jpn It Abliterated 17 ORPO
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Google Gemma4 12B
Gemma · NobodyWho
Params11.9B
Context256K
Q4_K_M7.1 GB
ReasoningTool useVision
GE
Gemma 4 26B A4B It Arli v3
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
mayi psy it
Gemma · xiaomayi025
Params4.63B
Context128K
Smallest3.4 GB
ReasoningTool use
GE
Gemma 2 Ataraxy v3 Advanced 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 7b It Trismegistus
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
vntl gemma2 27b
Gemma · lmg-anon
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
JapanRailwayLLM
Gemma · galakenya
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
sandepaAI_gemma4_coder_12b
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Gemma 4 E4B Gemini 3.1 Pro Reasoning Distill v2 Merged
Gemma · Abiray
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use

Keep browsing