Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 Harmonia 31B Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma 4 12B StyleTune
Gemma · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
Roleplay
GE
Gemma 4 E2B
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
GE
Gemma 4 26B A4B StyleTune QK Heretic
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
GE
gemma 4 E2B it qat q4 0 heretic
Gemma · FadedRedStar
Params4.63B
Context128K
Smallest0.1 GB
CodingVision
GE
Gemma 4 E2B It Uncensored MAX
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
Reasoning
GE
Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
anon 1b
Gemma · scratchyone
Params1B
Context32K
Smallest2.0 GB
GGUF
GE
Gemma 4 31B It Claude Opus Distill
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision
GE
Gemma2 Gutenberg Doppel 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 26B A4B it ara abliterated
Gemma · jenerallee78
Params25.2B
Context256K
Smallest20.6 GB
Vision
GE
Gemma 3 12b It Abliterated
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 31B It Claude Opus Distill v2 Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
GE
Fallen Gemma3 4B v1
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 12B Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Gemma 2 2b It
Gemma · BafS
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 26B A4B Heretic Stable
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
GE
Gemma The Writer 9B HERETIC Uncensored Abliterated
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
GE
Gemma 4 31B Fable 5 Agent Distill
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding
GE
Amoral Gemma3 12B v2
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
gemma 4 12B it qat MTP
Gemma · magnitudedev
Params423M
Context256K
Smallest0.3 GB
GGUF
GE
gemma 4 31B it qat q4 0 uncensored heretic
Gemma · llmfan46
Params30.7B
Context256K
Smallest17.7 GB
Vision
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Roleplay
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 26B A4B uncensored
Gemma · Riyan200324200324
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 2 9b It
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
DiarizationLM Gemma 4 E4B v1
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
Big Tiger Gemma 27B v3
Gemma · TheDrummer
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
GE
muraqib judge
Gemma · mohamedbalkhi169
Params7.46B
Context128K
Q4_K_M4.9 GB
GGUF
GE
Gemma 4 31B It Claude Opus Distill v2
Gemma · TeichAI
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningVision

Keep browsing