Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
gemma 4 12B opus reasoning
Gemma · MaxResDefault001
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 E4B It Qat Q4_0 Unquantized
Gemma · WhiskyAKM
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 27b Pt
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma Kimu 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 12b It Banglaprotha
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
ricepaper vi gemma 2b RAG
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma4 E2B It Abliterated
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Lion Gemma 7b Cn
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma_12B_Middle_Layers_1484
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Mlabonne.Gemma 3 12b It Abliterated v2
Gemma · DevQuasar
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 4 E4B imatrix awq
Gemma · pearsonkyle
Params7.52B
Context128K
Smallest0.1 GB
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · Dzluck
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 3 1b It Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
ricepaper vi gemma 2b specialized function calling
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 12b it qat heretic ud q4 k xl
Gemma · pegasus912
Params11.9B
Context256K
Smallest6.7 GB
GE
Gemma-4-12B-It
Gemma · eadx
Params11.9B
Context128K
Q4_K_M7.1 GB
GE
gemma 4 e4b it mtp assistant ultralight
Gemma · HackAfterDark
Params408M
Context128K
Smallest0.8 GB
GE
gemma ft q4 k m
Gemma · Divakarreddy
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 31B It Abliterated
Gemma · lhca521
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma4 RustyBender
Gemma · nathanles
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 4B THINKING
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 2b It Uncensored
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Google.Gemma 3 4b Pt
Gemma · DevQuasar-5
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 2B TR Knowledge Graph i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · lazywoof
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
gemma 4 E2B it agent posttrain v1.3
Gemma · XcaliburMoon
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Matick Gemma 4 E2B Mexicano v3
Gemma · danymorlet
Params271M
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 26B A4B Animus V14.1 FFT Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma-4-26B-A4B-it-Heretic
Gemma · deucebucket
Params25.2B
Context256K
Smallest11.7 GB
GE
Tiny Gemma Test
Gemma · mradermacher
Params8M
Context8K
Q4_K_M0.0 GB