Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 4 26B Sol Traces v1
Gemma · RedTeamLab
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Tiger Gemma 9B v3 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
ORANSight Gemma 2 2B Instruct i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 12b It Qat Int4 Unquantized Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemmasutra 9B V1B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
DiscoPOP-zephyr-7b-gemma
Gemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M6.3 GB
GE
Gemma 3n E4B It PaperWitch Heresy
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
zephyr-7b-gemma-sft-african-ultrachat-200k
Gemma · afrideva
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
jstredacted gemma 2b instruct trivia qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 cal
Gemma · build-small-hackathon
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 12B It Null Space Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 E4B It Mentalchat16K
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
sarvam-translate
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
haven chat v3.0
Gemma · haven-ai-companion
Params7.52B
Context128K
Smallest5.1 GB
GE
Discord Gemma 12B V1 Base MERGED
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Replete LLM gemma 9b test merged 250k
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Google Gemma4 E4B
Gemma · NobodyWho
Params7.52B
Context128K
Q4_K_M5.0 GB
GE
Gemma 4b Zulu Sft
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Sprinkle Vanilla Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Ganesh JavaScript v0.1.0
Gemma · Executespec
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 Gaia PT BR 4b It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
MT2 Gen11 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4b It Rude
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 2b It
Gemma · EasierAI
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 12b Marvin Gutenberg
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma-3-Gaia-PT-BR-4b-it
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
GraphMind Gemma2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 26B A4B it NVFP4
Gemma · FreedomAISVR
Params25.2B
Context256K
Smallest14.4 GB
GE
ChaThai Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma2 9b it for tripadvisor
Gemma · hienbm
Params9.24B
Context8K
Q4_K_M5.8 GB