Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
google gemma 3 27b it qat q4 0 gguf small
Gemma · stduhpf
Params27B
Context128K
Smallest15.6 GB
GE
tergel/gemma-2-2b-it-math-fs-gpt4o-bon
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma4 E4B MiniFantasy V1
Gemma · Nubinu
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E4B It
Gemma · professorf
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Saiga_Gemma3_12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Tiny Gemma Test
Gemma · mradermacher
Params8M
Context8K
Q4_K_M0.0 GB
GE
gemma4 e2b rknn3 rk1828
Gemma · t-firefly
Params—
Context128K
Smallest0.0 GB
GE
gemma ko 7b instruct v0.52 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Google Gemma 3 27b It Text
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Google Gemma 4 E2B It
Gemma · batiai
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
gemma 7b openhermes v0.80 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
gemma 4 31B it scotoma 2 GGUF long ctx
Gemma · DeusImperator
Params30.7B
Context256K
Smallest0.0 GB
GE
google gemma 3 1b it qat q4 0 gguf small
Gemma · stduhpf
Params1B
Context32K
Smallest0.7 GB
GE
Gemma3 Negative Glitter
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
MalayaLLM_Gemma_2_7B_Instruct_V1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Fabled Gemma4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
google_gemma-3-12b-it
Gemma · Mungert
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 26B A4B It
Gemma · Fr4nkSt3in
Params25.2B
Context256K
Smallest50.5 GB
GE
amoral gemma3 1B v2
Gemma · soob3123
Params1B
Context32K
Q4_K_M0.8 GB
GE
Grok 3 gemma3 4B distilled
Gemma · mfielding92
Params3.88B
Context128K
Smallest4.1 GB
GE
Gemma Radiation RP 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
ganda gemma 1b
Gemma · CraneAILabs
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 12b It Antislop Creative v0.2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Doktor Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Hebrew Gemma 11B
Gemma · mradermacher
Params10.5B
Context8K
Q4_K_M6.5 GB
GE
Alphi_v1_Frozen_FP16
Gemma · RyzovaTech
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2b Ru
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma2 Nephilim v3 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB