Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma4 Gutenberg 26B A4B Safetensors
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Gemma 4 31B It Arli
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 3 27b It Heretic v1.2
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 7b Aps It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma-7b-it
Gemma · brittlewis12
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2 2b Jpn It
Gemma · alfredplpl
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 4 12B it uncensored
Gemma · AgentAnon
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · ATOMIKMN
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma2 2b
Gemma · afg1
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 4b It Roleplay Tuned v1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
GE
Gemma 4 GodMode V9 Ultimate Pure
Gemma · hariom-ai-singh
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · Unrestricted
Params4.65B
Context128K
Smallest3.0 GB
ReasoningTool useVision
GE
Amoral_Sherlock Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma-2b
Gemma · LoneStriker
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Google.Gemma 3 4b It
Gemma · DevQuasar-10
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 Dark Horror 4B It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
CodingVision
GE
Gemma-4-31B-It
Gemma · ipsarkar
Params30.7B
Context256K
Q4_K_M18.3 GB
ReasoningTool useVision
GE
Gemma 3 Starshine Merge B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma-2b-orpo
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Google.Gemma 3 12b It
Gemma · DevQuasar-10
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma 4 12b it iq1 s
Gemma · mrysh
Params11.9B
Context256K
Smallest3.0 GB
ReasoningTool useVision
GE
Gemma 4 Novelist 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Gemma 2 2b Jpn It
Gemma · duyntnet
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 2 2b fa v2
Gemma · MaziyarPanahi
Params2.61B
Context8K
Smallest1.9 GB
GGUF
GE
Gemma 4 31B RedstoneDoor
Gemma · Nekochu
Params30.7B
Context256K
Smallest21.8 GB
ReasoningTool useVision
GE
Gemma 4 E2B German Spelling Full
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
GE
gemma 4 mtp drafters
Gemma · StoryArbor
Params423M
Context128K
Smallest0.1 GB
ReasoningTool use
GE
gemma 2 2b jpn it abliterated 24 i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma3 27b v2 Starlike
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF

Keep browsing