Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
GracieRP freefallenLora Gemma2 Inst 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
VeriCoder_Gemma12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 E4B It SDFT_Heretic_RP
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 26B A4B it qat NVFP4
Gemma · WhiskyAKM
Params25.2B
Context256K
Smallest0.3 GB
GE
Storyteller Gemma3 27B
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
GE
Gemma 4 31B FT It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
BugTraceAI Apex G4 26B Master f16
Gemma · BugTraceAI
Params25.2B
Context256K
Smallest50.5 GB
GE
Gemma 4 E4B It
Gemma · giladgd
Params7.5B
Context128K
Q4_K_M5.4 GB
GE
Gemma 4 26B A4B Heretic Stable
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 Gembrain 31B
Gemma · Nimbz
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B IT NVFP4
Gemma · esatapedico
Params30.7B
Context256K
Smallest17.3 GB
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 31B It
Gemma · giladgd
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma The Writer 9B HERETIC Uncensored Abliterated
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 Dark Gemistry 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
GE
Gemma3 27B It Vl GLM 4.7 Uncensored Heretic Deep Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma4 E4B It Abliterated AND Disinhibited USE THIS
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 27b It Abliterated
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 4 31B IT NVFP4 Src
Gemma · LibertAIDAI
Params30.7B
Context256K
Q4_K_M17.8 GB
GE
Docto Decision Gemma 4 E2B Fr v0.1
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
claude 3.7 sonnet reasoning gemma3 12B i1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 31B Humanlike Chat
Gemma · LessThanThreeAI
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 19B A4B It INSTRUCT Heretic Uncensored
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
GE
Copywriter Gemma4 31b
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
magnum v3 9b customgemma2
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 3 4b null space abliterated RP writer
Gemma · jwest33
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 19b A4B It REAP Heretic
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
GE
Gemma 4 12b Heretic Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 27b It Heretic
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 4b It Abliterated
Gemma · matrixportalx
Params3.88B
Context128K
Q4_K_M2.5 GB