Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 3 4b It Uncensored v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 26B A4B It Abliterix v6
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
ProtoSex RP Gemma2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Uncensored gemma 7b
Gemma · ICEPVP8977
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Models Mlabonne Gemma 3 1b It Abliterated
Gemma · MaziyarPanahi
Params1B
Context32K
Smallest0.8 GB
GE
Gemma 3 27B IT
Gemma · brittlewis12
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 4b It Roleplay Tuned v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 E2B Heretic
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma4 Ubw Heretic Lora v12
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 27b It Abliterated Normpreserve
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Aidc 5k Laos Gemma 3 4b It v2
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GE
Gemma 4 12B It Esper4Tachibana
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
openchat 3.5 0106 gemma
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma 3 27b it lecore
Gemma · staccs
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 31B
Gemma · UnitGrief
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Heretic
Gemma · scrybz
Params30.7B
Context256K
Smallest35.0 GB
GE
gemma4 e4b mahou nsfw
Gemma · nuofang
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 4b It Heretic Logic
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 2b It
Gemma · Kismi
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma 4 E4B it heretic
Gemma · kldzj
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 31B It Claude Opus Distill
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
amethyst 1 mini
Gemma · VertexAGI
Params4.55B
Context128K
Q4_K_M2.9 GB
GE
gemma-3n-E4B-it
Gemma · Mungert
Params6.87B
Context32K
Q4_K_M4.8 GB
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · gmonsoon
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
google gemma 4 E4B it tictactoe
Gemma · moe249
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
rsrishi10 gemma text2sql Instruct Finetune test
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB