Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-3-1B-It
Gemma · shehrozrafaqat
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 2b Jpn It Abliterated 18
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Gemma2 9b KuwaNovelist v4 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
generalbakudan gemma 2b instruct ft medical qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 2 Ataraxy v4 Advanced 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b It DPO
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 2 2b dunsany i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 12b It MPOAdd v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma 2b
Gemma · nold
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
medgemma-27b-text-it
Gemma · Mungert
Params27B
Context128K
Q4_K_M16.3 GB
Reasoning
GE
gemma 2b aps it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma_Delirium_Rewired_9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-2b-it
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
MultimodalTopic 12B Gemma3 Flash
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 21b A4B It REAP Heretic
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
CodingReasoningTool use
GE
Gemma 3 JP EN Translator v1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 E4B Claude Abliterated
Gemma · DuoNeural
Params7.52B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GE
Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
Locus Gemma 4 E2B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
GemmaTranslate v3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma-2b-data-std
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
The Omega Abomination Gemma3 12B v1.0
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
Hebrew Gemma 11B
Gemma · mradermacher
Params10.5B
Context8K
Q4_K_M6.5 GB
GGUF
GE
Gemma 1.1 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma3 27b Abliterated Dpo
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
gemma-3-12b-it-codeforces-SFT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
MT gemma 4 8B E4B
Gemma · zelk12
Params7.52B
Context128K
Smallest6.2 GB
ReasoningTool useVision
GE
Gemma 3 Dark Horror 4B It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Coding
GE
Ko Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing