Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-3-1B-It
Gemma · Obaidhrhsl
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 4 31B It
Gemma · SoAIHQ
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
QiMing Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GE
Gemma 4 26B A4B It Assistant
Gemma · ManniX-ITA
Params420M
Context256K
Q4_K_M0.3 GB
Vision
GE
Gemma3 9b It Girl v3
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 GodMode V9 Ultimate
Gemma · sana0756
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
gemma 7b openhermes i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
GE
Magnolia v1 Gemma2 8k 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 E4B it qat q4 0
Gemma · asincole
Params7.46B
Context128K
Smallest5.2 GB
ReasoningTool useVision
GE
gemma 4 E2B it qat q4 0
Gemma · asincole
Params4.63B
Context128K
Smallest3.3 GB
ReasoningTool useVision
GE
onebee gf distill v1
Gemma · arjhinety
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Google.Gemma 3 270m It
Gemma · DevQuasar
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
YFolla.gemma 3 Dnd
Gemma · DevQuasar-11
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma 4 26B A4B it qat heretic
Gemma · npario
Params25.2B
Context256K
Smallest14.2 GB
CodingReasoningTool use
GE
G2 9B Aletheia v1
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-3-4B-It
Gemma · socrate-tech
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Google Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b It Uncensored HERETIC Gemini Deep Reasoning
Gemma · kainah
Params27B
Context128K
Q4_K_M16.5 GB
ReasoningVision
GE
Gemma-4-26B-A4B-It
Gemma · wolfliu
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 27b It Abliterated
Gemma · danielmnd
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Text To Cypher Gemma 3 27B Instruct 2025.04.0
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 4 12B It
Gemma · FastFlowLM
Params11.9B
Context256K
Smallest6.7 GB
ReasoningTool useVision
GE
QiMing Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
gemma 4 12b adql orig
Gemma · Machacini
Params11.9B
Context256K
Smallest23.8 GB
ReasoningTool use
GE
Gemma-3N-E4B-It
Gemma · BaybeDragon
Params6.87B
Context32K
Q4_K_M4.5 GB
Vision
GE
Aura Medium v1.1
Gemma · UncannyEcho
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision

Keep browsing