Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
gemma-2-27b-it
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Huihui gemma 4 12B agentic fable5 abliterated
Gemma · huihui-ai
Params11.9B
Context256K
Smallest0.9 GB
GE
Assistant
Gemma · RachidAR
Params420M
Context128K
Smallest0.2 GB
GE
Gemma 4 E4B It OBLITERATED v3.1
Gemma · Aimeeluvssya
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 Novelist Eclipse 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Fallen Gemma3 27B v1
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2 27b It
Gemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GE
Gemma 4 E2B it Artemis
Gemma · turintech
Params4.63B
Context128K
Smallest0.1 GB
GE
gemma 4 31B it
Gemma · AtomicChat
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
gemma 4 31B it scotoma 2
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E2B It Heretic v1
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 Writers 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Huihui gemma 4 E2B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params4.63B
Context128K
Smallest0.2 GB
GE
Gemma 3 4b It Abliterated
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 4b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params3.88B
Context128K
Smallest2.5 GB
GE
TangYuGe Gemma 4 12b It Qat
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 26B A4B it
Gemma · AtomicChat
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
ThinkingCap Gemma 4 26B A4B It
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 27b It
Gemma · lmstudio-community
Params27B
Context128K
Q4_K_M16.5 GB
GE
Ablation 187 Gemma3.Webnovels.Test.Gemma 3 4b
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 26B A4B It Uncensored
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma4 12B IT Abliterated
Gemma · DuoNeural
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 4 E2B It Heretic Ara
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
BgGPT Gemma 3 27B IT
Gemma · INSAIT-Institute
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 4 31b Novel Merged
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Nz Gemma4 12B LTX25
Gemma · Rootport
Params13.1B
Context—
Q4_K_M9.2 GB
GE
Gemma 4 12B EsperGrug
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB