Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
INSAIT Institute.BgGPT Gemma 2 2.6B IT v1.0
Gemma · DevQuasar-3
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
ERAnalyst Dayo 8B
Gemma · mengbau
Params7.52B
Context128K
Smallest5.8 GB
ReasoningTool use
GE
Gemma 4 31B It Obliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma-4-26B-A4B-It
Gemma · ipsarkar
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · vladim233334
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 2 lyco infinity 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1b Pt
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 4 12B it
Gemma · ruygar
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 4 26b A4B It
Gemma · Krasnopjorovs
Params25.2B
Context256K
Smallest13.9 GB
ReasoningTool use
GE
gemma 3 4b instruct custom v1
Gemma · aryannaik-91
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Gemma 3n E4B It Absolute Heresy
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
GE
Gemma 4 E2B Claude Sonnet 4.6
Gemma · Blshu
Params4.63B
Context128K
Smallest3.8 GB
ReasoningTool useVision
GE
Gemma 2 2B Allenai Tulu 3 Sft Full Mix
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
LaToucheCarre Texte XL Gemma 4 E4B QAT UD Q4 K XL FR EN
Gemma · LaToucheCarre
Params6.09B
Context128K
Smallest3.4 GB
ReasoningTool use
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
MamayLM Gemma 3 4B IT v1.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 31B_Opus 4.6 Reasoning 3300x
Gemma · cloudbjorn
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
GE
Gemma 3 12b It Adv
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma-4-26B-A4B-It
Gemma · Camcarroll120
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
GE
Coder3101 Gemma 4 E2B it heretic
Gemma · L-Alchemyst
Params4.65B
Context128K
Q4_K_M3.4 GB
CodingReasoningTool use
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · eadx
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Amoral Gemma3 12B v2 Qat
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 E4B Cymraeg v4
Gemma · mradermacher
Params8.13B
Context128K
Q4_K_M5.0 GB
ReasoningTool use
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · codeslord
Params12B
Context—
Q4_K_M7.4 GB
ReasoningTool use
GE
go2 ft 04
Gemma · SageStack01
Params4.63B
Context128K
Smallest3.4 GB
ReasoningTool use
GE
Athena Gemma 2 9b It Philos
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
R01 Gemma 3 1b It
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 4 E4B It Assistant
Gemma · cafkafk
Params79M
Context128K
Q4_K_M0.1 GB
GGUF

Keep browsing