Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 26B Sol Traces v1
Gemma · RedTeamLab
Params25.2B
Context256K
Q4_K_M16.8 GB
CodingReasoningTool use
GE
Tiger Gemma 9B v3 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
ORANSight Gemma 2 2B Instruct i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 12b It Qat Int4 Unquantized Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemmasutra 9B V1B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
DiscoPOP-zephyr-7b-gemma
Gemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M6.3 GB
GGUF
GE
Gemma 3n E4B It PaperWitch Heresy
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
zephyr-7b-gemma-sft-african-ultrachat-200k
Gemma · afrideva
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
jstredacted gemma 2b instruct trivia qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 cal
Gemma · build-small-hackathon
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 4 12B It Null Space Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 4 E4B It Mentalchat16K
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
sarvam-translate
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
haven chat v3.0
Gemma · haven-ai-companion
Params7.52B
Context128K
Smallest5.1 GB
ReasoningRoleplayTool use
GE
Discord Gemma 12B V1 Base MERGED
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Replete LLM gemma 9b test merged 250k
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Google Gemma4 E4B
Gemma · NobodyWho
Params7.52B
Context128K
Q4_K_M5.0 GB
ReasoningTool useVision
GE
Gemma 4b Zulu Sft
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Sprinkle Vanilla Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Ganesh JavaScript v0.1.0
Gemma · Executespec
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Gemma 3 Gaia PT BR 4b It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
MT2 Gen11 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4b It Rude
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · EasierAI
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 12b Marvin Gutenberg
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma-3-Gaia-PT-BR-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
GraphMind Gemma2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 26B A4B it NVFP4
Gemma · FreedomAISVR
Params25.2B
Context256K
Smallest14.4 GB
ReasoningVision
GE
ChaThai Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
gemma2 9b it for tripadvisor
Gemma · hienbm
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing