Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma3 Omen 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
nooynoos gemma2 2b M.O.M gemma sprint
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Google_Gemma 3 12b It
Gemma · marcelone
Params11.8B
Context128K
Smallest6.9 GB
GE
gemma 4 26B A4B opus reasoning
Gemma · MaxResDefault001
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
SoliDeoGloria Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E2B It
Gemma · professorf
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 31B It
Gemma · shainmeena
Params30.7B
Context256K
Q4_K_M19.6 GB
GE
bge reranker v2 gemma i1
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 3 4b It Null Space Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Ruqiya/Fine-Tuning-Gemma-2b-it-for-Arabic
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
christinechagas gemma 2b instruct ft health bot
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
recoilme gemma 2 9B v0.3 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Hemispheres v0.2 Gemma2 9B Combo
Gemma · theprint
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemmasutra Mini 2B v1
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma 2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 31B It Heretic Ara Custom
Gemma · MoonRide
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
LEM Gemma3 1B Fp16
Gemma · LetheanNetwork
Params1.3B
Context32K
Q4_K_M1.0 GB
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma3_12B_Mulitmodal_Sft_02 01 2026
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 R1 12B v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 4 26B A4B it
Gemma · Advantech-EIOT
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3n E4B It Abliterated
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2b It Bnb 4bit
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Amoral Gemma3 12B v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
adi gemma3 12b ablit glm5.2
Gemma · AdvancedDataIntelligence
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
GemmaX2 28 2B v0.1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 4b Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB