Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 E2B It ARA Heresy
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma4 26B A4B Uncensored HauhauCS Bal Ollama Text
Gemma · braydenh563
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool use
GE
Gemma 3n E2B It Absolute Heresy MPOA
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
GE
Twentle Gemma 4
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Gemma 3 27b It FT Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
ReasoningVision
GE
Nietzsche_Abliterated Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 9b It SimPO ComPO 2
Gemma · DZgas
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-12B-It
Gemma · sebidev
Params11.9B
Context256K
Q4_K_M7.1 GB
Vision
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · eyentsign
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 4 E4B it qat assistant MTP Q8 0
Gemma · amaranus
Params78M
Context128K
Smallest0.1 GB
ReasoningTool use
GE
Gemma 2 9B It SPPO Iter1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 E2B it uncensored
Gemma · Anachronox39
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
gemma ko 7b instruct v0.71 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 Giftige Blume 31B v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
H GEMMA4 SFT INSTRUCT
Gemma · Shrijanagain
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma 4 E2B It
Gemma · san27079
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 2 9B PL DevOps Instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v1 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
gemma 4 26B A4B it NVFP4
Gemma · ggufbench
Params25.2B
Context256K
Smallest17.7 GB
ReasoningTool useVision
GE
Gemma 3 27B MeditronFO Amharic
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
Vision
GE
gemma 4 12B it heretic volta
Gemma · megabytes
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
GE
zelk12 MT5 Gen1 gemma 2 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12b It
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest6.6 GB
ReasoningTool useVision
GE
TiTan Gemma3 4B
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
GE
lyrics room topline gemma4 12b v9
Gemma · rambrogi
Params11.9B
Context256K
Smallest9.8 GB
ReasoningTool use
GE
Gemma 3 27b Experiment Storyteller
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2 2B Stheno Filtered
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 27B Technical Tutorial Summarization QLoRA
Gemma · mradermacher
Params27.2B
Context16K
Q4_K_M16.6 GB
GGUF
GE
at2507 gemma 2b instruct ft python code instructions
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
Coding
GE
Gemma 4 31B Animus V15.1 Swa
Gemma · Darkhn-Quants-4
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use

Keep browsing