Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma3 Omen 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
GE
nooynoos gemma2 2b M.O.M gemma sprint
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Google_Gemma 3 12b It
Gemma · marcelone
Params11.8B
Context128K
Smallest6.9 GB
Vision
GE
gemma 4 26B A4B opus reasoning
Gemma · MaxResDefault001
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
SoliDeoGloria Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma 4 E2B It
Gemma · professorf
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma 4 31B It
Gemma · shainmeena
Params30.7B
Context256K
Q4_K_M19.6 GB
ReasoningTool useVision
GE
bge reranker v2 gemma i1
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
Embedding
GE
Gemma 3 4b It Null Space Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Ruqiya/Fine-Tuning-Gemma-2b-it-for-Arabic
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
christinechagas gemma 2b instruct ft health bot
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
recoilme gemma 2 9B v0.3 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Hemispheres v0.2 Gemma2 9B Combo
Gemma · theprint
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 31B It Heretic Ara Custom
Gemma · MoonRide
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
LEM Gemma3 1B Fp16
Gemma · LetheanNetwork
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Gemma 7B Instruct Function Calling
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
GE
Gemma3_12B_Mulitmodal_Sft_02 01 2026
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 R1 12B v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
gemma 4 26B A4B it
Gemma · Advantech-EIOT
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Gemma 3n E4B It Abliterated
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma 2b It Bnb 4bit
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Amoral Gemma3 12B v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
adi gemma3 12b ablit glm5.2
Gemma · AdvancedDataIntelligence
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
GemmaX2 28 2B v0.1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 4b Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF

Keep browsing