Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
google gemma 3 27b it qat q4 0 gguf small
Gemma · stduhpf
Params27B
Context128K
Smallest15.6 GB
Vision
GE
tergel/gemma-2-2b-it-math-fs-gpt4o-bon
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma4 E4B MiniFantasy V1
Gemma · Nubinu
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
GE
Gemma 4 E4B It
Gemma · professorf
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Saiga_Gemma3_12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Tiny Gemma Test
Gemma · mradermacher
Params8M
Context8K
Q4_K_M0.0 GB
GGUF
GE
gemma4 e2b rknn3 rk1828
Gemma · t-firefly
Params—
Context128K
Smallest0.0 GB
ReasoningTool use
GE
gemma ko 7b instruct v0.52 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Google Gemma 3 27b It Text
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Google Gemma 4 E2B It
Gemma · batiai
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
GE
gemma 7b openhermes v0.80 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
GE
gemma 4 31B it scotoma 2 GGUF long ctx
Gemma · DeusImperator
Params30.7B
Context256K
Smallest0.0 GB
GGUF
GE
google gemma 3 1b it qat q4 0 gguf small
Gemma · stduhpf
Params1B
Context32K
Smallest0.7 GB
GGUF
GE
Gemma3 Negative Glitter
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
MalayaLLM_Gemma_2_7B_Instruct_V1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Fabled Gemma4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
google_gemma-3-12b-it
Gemma · Mungert
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 26B A4B It
Gemma · Fr4nkSt3in
Params25.2B
Context256K
Smallest50.5 GB
ReasoningTool useVision
GE
amoral gemma3 1B v2
Gemma · soob3123
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Grok 3 gemma3 4B distilled
Gemma · mfielding92
Params3.88B
Context128K
Smallest4.1 GB
GGUF
GE
Gemma Radiation RP 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
GE
ganda gemma 1b
Gemma · CraneAILabs
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 12b It Antislop Creative v0.2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Tool useVision
GE
Doktor Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Hebrew Gemma 11B
Gemma · mradermacher
Params10.5B
Context8K
Q4_K_M6.5 GB
GGUF
GE
Alphi_v1_Frozen_FP16
Gemma · RyzovaTech
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma 2b Ru
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma2 Nephilim v3 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing