Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma-3-1B-It
Gemma · Obaidhrhsl
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 4 31B It
Gemma · SoAIHQ
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
QiMing Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 26B A4B It Assistant
Gemma · ManniX-ITA
Params420M
Context256K
Q4_K_M0.3 GB
GE
Gemma3 9b It Girl v3
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 GodMode V9 Ultimate
Gemma · sana0756
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
gemma 7b openhermes i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Magnolia v1 Gemma2 8k 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 E4B it qat q4 0
Gemma · asincole
Params7.46B
Context128K
Smallest5.2 GB
GE
gemma 4 E2B it qat q4 0
Gemma · asincole
Params4.63B
Context128K
Smallest3.3 GB
GE
onebee gf distill v1
Gemma · arjhinety
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Google.Gemma 3 270m It
Gemma · DevQuasar
Params268M
Context32K
Q4_K_M0.3 GB
GE
YFolla.gemma 3 Dnd
Gemma · DevQuasar-11
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 4 26B A4B it qat heretic
Gemma · npario
Params25.2B
Context256K
Smallest14.2 GB
GE
G2 9B Aletheia v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-3-4B-It
Gemma · socrate-tech
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Google Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 27b It Uncensored HERETIC Gemini Deep Reasoning
Gemma · kainah
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma-4-26B-A4B-It
Gemma · wolfliu
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 27b It Abliterated
Gemma · danielmnd
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Text To Cypher Gemma 3 27B Instruct 2025.04.0
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 4 12B It
Gemma · FastFlowLM
Params11.9B
Context256K
Smallest6.7 GB
GE
QiMing Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 4 12b adql orig
Gemma · Machacini
Params11.9B
Context256K
Smallest23.8 GB
GE
Gemma-3N-E4B-It
Gemma · BaybeDragon
Params6.87B
Context32K
Q4_K_M4.5 GB
GE
Aura Medium v1.1
Gemma · UncannyEcho
Params11.9B
Context256K
Q4_K_M7.4 GB