Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 4 E2B It ARA Heresy
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma4 26B A4B Uncensored HauhauCS Bal Ollama Text
Gemma · braydenh563
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
Gemma 3n E2B It Absolute Heresy MPOA
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GE
Twentle Gemma 4
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 27b It FT Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Nietzsche_Abliterated Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 2 9b It SimPO ComPO 2
Gemma · DZgas
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-4-12B-It
Gemma · sebidev
Params11.9B
Context256K
Q4_K_M7.1 GB
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · eyentsign
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E4B it qat assistant MTP Q8 0
Gemma · amaranus
Params78M
Context128K
Smallest0.1 GB
GE
Gemma 2 9B It SPPO Iter1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 E2B it uncensored
Gemma · Anachronox39
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
gemma ko 7b instruct v0.71 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 4 Giftige Blume 31B v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
H GEMMA4 SFT INSTRUCT
Gemma · Shrijanagain
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 E2B It
Gemma · san27079
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2 9B PL DevOps Instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v1 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 4 26B A4B it NVFP4
Gemma · ggufbench
Params25.2B
Context256K
Smallest17.7 GB
GE
Gemma 3 27B MeditronFO Amharic
Gemma · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
GE
gemma 4 12B it heretic volta
Gemma · megabytes
Params11.9B
Context256K
Smallest0.3 GB
GE
zelk12 MT5 Gen1 gemma 2 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 12b It
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest6.6 GB
GE
TiTan Gemma3 4B
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GE
lyrics room topline gemma4 12b v9
Gemma · rambrogi
Params11.9B
Context256K
Smallest9.8 GB
GE
Gemma 3 27b Experiment Storyteller
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2 2B Stheno Filtered
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2 27B Technical Tutorial Summarization QLoRA
Gemma · mradermacher
Params27.2B
Context16K
Q4_K_M16.6 GB
GE
at2507 gemma 2b instruct ft python code instructions
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 31B Animus V15.1 Swa
Gemma · Darkhn-Quants-4
Params30.7B
Context256K
Q4_K_M18.7 GB