Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma-3-1B-It
Gemma · shehrozrafaqat
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 2 2b Jpn It Abliterated 18
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma2 9b KuwaNovelist v4 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
generalbakudan gemma 2b instruct ft medical qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 2 Ataraxy v4 Advanced 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 9b It DPO
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 2 2b dunsany i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 12b It MPOAdd v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 2b
Gemma · nold
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
medgemma-27b-text-it
Gemma · Mungert
Params27B
Context128K
Q4_K_M16.3 GB
GE
gemma 2b aps it
Gemma · QuantFactory
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma_Delirium_Rewired_9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma-2b-it
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
MultimodalTopic 12B Gemma3 Flash
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 21b A4B It REAP Heretic
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
GE
Gemma 3 JP EN Translator v1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 E4B Claude Abliterated
Gemma · DuoNeural
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 2 2b
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Locus Gemma 4 E2B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
GemmaTranslate v3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma-2b-data-std
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
The Omega Abomination Gemma3 12B v1.0
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Hebrew Gemma 11B
Gemma · mradermacher
Params10.5B
Context8K
Q4_K_M6.5 GB
GE
Gemma 1.1 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma3 27b Abliterated Dpo
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma-3-12b-it-codeforces-SFT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
MT gemma 4 8B E4B
Gemma · zelk12
Params7.52B
Context128K
Smallest6.2 GB
GE
Gemma 3 Dark Horror 4B It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Ko Gemma 2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB