Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 12B opus reasoning
Gemma · MaxResDefault001
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 4 E4B It Qat Q4_0 Unquantized
Gemma · WhiskyAKM
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 3 27b Pt
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma Kimu 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 12b It Banglaprotha
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
ricepaper vi gemma 2b RAG
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma4 E2B It Abliterated
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Lion Gemma 7b Cn
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma_12B_Middle_Layers_1484
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Mlabonne.Gemma 3 12b It Abliterated v2
Gemma · DevQuasar
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
gemma 4 E4B imatrix awq
Gemma · pearsonkyle
Params7.52B
Context128K
Smallest0.1 GB
GGUF
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · Dzluck
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma 3 1b It Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
ricepaper vi gemma 2b specialized function calling
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
Tool use
GE
gemma 4 12b it qat heretic ud q4 k xl
Gemma · pegasus912
Params11.9B
Context256K
Smallest6.7 GB
CodingReasoningTool use
GE
Gemma-4-12B-It
Gemma · eadx
Params11.9B
Context128K
Q4_K_M7.1 GB
ReasoningTool useVision
GE
gemma 4 e4b it mtp assistant ultralight
Gemma · HackAfterDark
Params408M
Context128K
Smallest0.8 GB
GGUF
GE
gemma ft q4 k m
Gemma · Divakarreddy
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 31B It Abliterated
Gemma · lhca521
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma4 RustyBender
Gemma · nathanles
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 3 4B THINKING
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Gemma 2 2b It Uncensored
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Google.Gemma 3 4b Pt
Gemma · DevQuasar-5
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 2 2B TR Knowledge Graph i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · lazywoof
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
gemma 4 E2B it agent posttrain v1.3
Gemma · XcaliburMoon
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Matick Gemma 4 E2B Mexicano v3
Gemma · danymorlet
Params271M
Context128K
Q4_K_M3.4 GB
EmbeddingVision
GE
Gemma 4 26B A4B Animus V14.1 FFT Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
Gemma-4-26B-A4B-it-Heretic
Gemma · deucebucket
Params25.2B
Context256K
Smallest11.7 GB
CodingReasoningTool use
GE
Tiny Gemma Test
Gemma · mradermacher
Params8M
Context8K
Q4_K_M0.0 GB
GGUF

Keep browsing