Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
INSAIT Institute.BgGPT Gemma 2 2.6B IT v1.0
Gemma · DevQuasar-3
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
ERAnalyst Dayo 8B
Gemma · mengbau
Params7.52B
Context128K
Smallest5.8 GB
GE
Gemma 4 31B It Obliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma-4-26B-A4B-It
Gemma · ipsarkar
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · vladim233334
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
gemma 2 lyco infinity 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 1b Pt
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
gemma 4 12B it
Gemma · ruygar
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 26b A4B It
Gemma · Krasnopjorovs
Params25.2B
Context256K
Smallest13.9 GB
GE
gemma 3 4b instruct custom v1
Gemma · aryannaik-91
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3n E4B It Absolute Heresy
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GE
Gemma 4 E2B Claude Sonnet 4.6
Gemma · Blshu
Params4.63B
Context128K
Smallest3.8 GB
GE
Gemma 2 2B Allenai Tulu 3 Sft Full Mix
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
LaToucheCarre Texte XL Gemma 4 E4B QAT UD Q4 K XL FR EN
Gemma · LaToucheCarre
Params6.09B
Context128K
Smallest3.4 GB
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
MamayLM Gemma 3 4B IT v1.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 7b
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 4 31B_Opus 4.6 Reasoning 3300x
Gemma · cloudbjorn
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 12b It Adv
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma-4-26B-A4B-It
Gemma · Camcarroll120
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
Coder3101 Gemma 4 E2B it heretic
Gemma · L-Alchemyst
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · eadx
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Amoral Gemma3 12B v2 Qat
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 E4B Cymraeg v4
Gemma · mradermacher
Params8.13B
Context128K
Q4_K_M5.0 GB
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · codeslord
Params12B
Context—
Q4_K_M7.4 GB
GE
go2 ft 04
Gemma · SageStack01
Params4.63B
Context128K
Smallest3.4 GB
GE
Athena Gemma 2 9b It Philos
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
R01 Gemma 3 1b It
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 4 E4B It Assistant
Gemma · cafkafk
Params79M
Context128K
Q4_K_M0.1 GB