Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 4 Harmonia 31B Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
GE
Gemma 4 E2B
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
gemma 4 E2B it qat q4 0 heretic
Gemma · FadedRedStar
Params4.63B
Context128K
Smallest0.1 GB
GE
Gemma 4 E2B It Uncensored MAX
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
anon 1b
Gemma · scratchyone
Params1B
Context32K
Smallest2.0 GB
GE
Gemma 4 31B It Claude Opus Distill
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma2 Gutenberg Doppel 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 26B A4B it ara abliterated
Gemma · jenerallee78
Params25.2B
Context256K
Smallest20.6 GB
GE
Gemma 3 12b It Abliterated
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Fallen Gemma3 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 12B Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 2 2b It
Gemma · BafS
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 26B A4B Heretic Stable
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma The Writer 9B HERETIC Uncensored Abliterated
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 31B Fable 5 Agent Distill
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Amoral Gemma3 12B v2
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 4 12B it qat MTP
Gemma · magnitudedev
Params423M
Context256K
Smallest0.3 GB
GE
gemma 4 31B it qat q4 0 uncensored heretic
Gemma · llmfan46
Params30.7B
Context256K
Smallest17.7 GB
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 26B A4B uncensored
Gemma · Riyan200324200324
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
DiarizationLM Gemma 4 E4B v1
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Big Tiger Gemma 27B v3
Gemma · TheDrummer
Params28.4B
Context128K
Q4_K_M17.3 GB
GE
muraqib judge
Gemma · mohamedbalkhi169
Params7.46B
Context128K
Q4_K_M4.9 GB
GE
Gemma 4 31B It Claude Opus Distill v2
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB