Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
gemma 4 31B it qat MTP
Gemma · magnitudedev
Params470M
Context128K
Smallest0.3 GB
GE
Gemma 4 26B A4B It
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 19B A4B It The DECKARD Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
GE
Gemma 3 12b It
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 270m It Qat
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GE
gemma 4 E4B it uncensored vision
Gemma · InfinimindCreations
Params7.5B
Context128K
Smallest8.0 GB
GE
Gemma 3 12b It Jailbreak ES
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 3 4b it roleplay tuned v2
Gemma · Indexnusrefather
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma-2-27b-it
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
gemma-4-12B-it-heretic
Gemma · JMingo
Params11.9B
Context256K
Q4_K_M7.1 GB
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
GE
Gemma The Writer N Restless Quill V2 Enhanced32 10B Uncensored
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.1 GB
GE
Gemma 4 21b A4B It REAP Heretic
Gemma · mradermacher
Params20.8B
Context256K
Q4_K_M13.8 GB
GE
Gemma 2 2b Jpn It
Gemma · webbigdata
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma-3-4B-It
Gemma · zw89
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 R1 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 4 e2b it
Gemma · nile-academy
Params4.63B
Context128K
Smallest3.3 GB
GE
0pen
Gemma · 0penAGI
Params7.46B
Context128K
Smallest0.9 GB
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 4b
Gemma · lmstudio-community
Params3.88B
Context128K
Smallest2.4 GB
GE
gemma 3 12b it qat q4 0
Gemma · google
Params11.8B
Context—
Smallest8.1 GB
GE
Skaldic Gemma 4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 26B A4B It Arli
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 2 2b It
Gemma · ThomasBaruzier
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Ru Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 4 26B A4B it Uncensored Apex Quality
Gemma · Furude0Rika
Params25.2B
Context256K
Smallest19.7 GB
GE
Gemma 4 26B Roleplay v2 Merged
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · jie1888
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma4 E4B 8B Heretic Ultra
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 The Deckards Brain 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB