Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 3 4b Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 R1 12B v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 27b Half Full
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma-4-E2B-It
Gemma · Straet
Params4.65B
Context128K
Q4_K_M3.1 GB
GE
Gemma 3 4b It Qat Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 Earthen v0.2 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 31B It The DECKARD HERETIC UNCENSORED Thinking
Gemma · jingamin
Params30.7B
Context256K
Smallest21.8 GB
GE
Gemma 3 1b It
Gemma · tatsuyaaaaaaa
Params1B
Context32K
Q4_K_M0.8 GB
GE
GemmaColRAC AeroExpertV4
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 7b Aps It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
GemmaX2 28 2B v0.2
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 12b It Uncensored
Gemma · claymorecrystal
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 4 26B A4B StyleTune
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 3 1b It
Gemma · duyntnet
Params1B
Context32K
Q4_K_M0.8 GB
GE
code il E4B
Gemma · BrainboxAI
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 2 2b It
Gemma · dahara1
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma SEA LION v4 4B VL
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma4 31B 1bit
Gemma · arcticoneai
Params3.77B
Context—
Smallest3.8 GB
GE
Gemma 4 26B A4B it Cerebellum v6
Gemma · deucebucket
Params25.2B
Context256K
Smallest11.7 GB
GE
Gemma2 9b Cpt Sea Lionv3 Instruct
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Google.Gemma 3 27b Pt
Gemma · DevQuasar-10
Params27B
Context128K
Q4_K_M16.5 GB
GE
Wansi gemma 2b instruct ft apple qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 12B It
Gemma · Krasnopjorovs
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 1b It
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Shirdel Finance E4B
Gemma · Tesleum
Params7.52B
Context128K
Smallest6.2 GB
GE
grimjim 12B Gemma 3 it norm preserved biprojected abliterated
Gemma · RossAscends
Params11.8B
Context128K
Smallest4.3 GB
GE
Gemma 3 4b_X Ray Abli_Linear_v1.01
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
llm gemma4 heretic 31b q4km
Gemma · yuanyeyuanye
Params30.7B
Context256K
Smallest18.7 GB
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3n E4B It
Gemma · mmnga
Params6.87B
Context32K
Q4_K_M4.2 GB