Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
gemma 3 12b it ultra uncensored heretic
Gemma · llmfan46
Params11.8B
Context128K
Smallest4.8 GB
GE
Gemma 4 26B A4B It Assistant
Gemma · AtomicChat
Params420M
Context256K
Q4_K_M0.3 GB
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Octopus-v2
Gemma · NexaAI
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 31B it Mystery Fine Tune HERETIC UNCENSORED Thinking Instruct
Gemma · DavidAU
Params30.7B
Context256K
Smallest17.8 GB
GE
Gemma 3 4b It Abliterated
Gemma · mlabonne
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 E4B It OBLITERATED
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Vikhr-Gemma-2B-instruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma-4-E2B-It
Gemma · mnsims1024
Params4.65B
Context128K
Q4_K_M3.1 GB
GE
humanizer-12b
Gemma · npario
Params11.9B
Context256K
Q4_K_M7.6 GB
GE
Gemma 4 Writers 31B V2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E4B Luchador
Gemma · bartowski
Params7.5B
Context128K
Q4_K_M5.4 GB
GE
Gemma4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
GE
Forge 1 Gemma 4 E2B
Gemma · YoSaNoo
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
google gemma 2b it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic v2
Gemma · OS-Software
Params25.2B
Context256K
Smallest14.2 GB
GE
Docto Decision Gemma 4 E4B Fr v0.1
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 270m It
Gemma · gguf-org
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 2 27b It
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 4 Gembrain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 26B A4B It Claude Opus Distill v2
Gemma · TeichAI
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
burtenshaw GemmaCoder3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 Garnet V2 31B It Ultra Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
gemma 4 12B it Claude 4.6 4.8 Opus
Gemma · yuxinlu1
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 4 26B A4B Heretic Stable
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma-4-E2B-It
Gemma · UnitGrief
Params4.65B
Context128K
Q4_K_M3.1 GB
GE
Gemma 4 31b It Heretic Ara
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB