Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
openchat 3.5 0106 gemma i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 4 31B it scotoma
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Amoral Gemma3 4B v2 Qat
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Bbuddy v2 Gemma3 4B Nsfw HF
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 26B A4B It
Gemma · grapeV-ai
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
Eunoia Gemma 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Misogyny
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 27b Pt LucyV1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 12b It Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 31b nomDePlume
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
silent_voice_multimodal_model
Gemma · 0xroyce
Params6.87B
Context32K
Smallest7.3 GB
GGUF
GE
ecdev gemma 2b instruct ft medical qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Ko Gemma 2 9b It
Gemma · KIST-robot-intelligence
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Atlasv13 Gemma4 26b
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma 3 12b It Qat Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 Harmonia 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
MT1 Gen2 MMMU gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 270m instruct
Gemma · lm-kit
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
gemma-2-9b-it
Gemma · zhezhe
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-2b-it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
EX Ai1 3.88B Gemma3
Gemma · EXAiStudio
Params3.88B
Context128K
Smallest2.5 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · minte1431
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
abdulmannan 01 gemma 2 2b finetuned for json generation
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Text To Cypher Gemma 3 4B Instruct 2025.04.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma 4 26B A4B Claude Opus 4.7 QAT Q4 0 Heretic
Gemma · DFveloper
Params25.2B
Context256K
Smallest14.4 GB
ReasoningTool useVision
GE
Gemma 4 12B It Desiccated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma-2b-it-tamil-v0.1-alpha
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
translate gemma 4 sub e2b
Gemma · 17slever17
Params4.65B
Context128K
Smallest0.1 GB
ReasoningTool useVision
GE
Ariane_Gemma
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF

Keep browsing