Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 E4B It Erotica
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Coder3101_Gemma_4_31B_It_Heretic
Gemma · Stabhappy
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingVision
GE
Gemma 4 26B A4B QAT Voice GGUFs
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
ReasoningTool useVision
GE
gemma 3n E2B it
Gemma · ggml-org
Params4.46B
Context32K
Smallest4.8 GB
GGUF
GE
Huihui Gemma 4 12B Coder Fable5 Composer2.5 v1 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
GE
gemma 4 26B A4B it MTP
Gemma · ironbcc
Params420M
Context256K
Q4_K_M0.3 GB
GGUF
GE
Fallen Gemma3 12B v1
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 MoonGem 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · princepppp
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
GE
Gemma 4 12B It Qat Q4_0 Unquantized Heretic v1.1
Gemma · igorls
Params11.9B
Context256K
Smallest7.0 GB
GGUF
GE
Gemma4 Gutenberg Literotica 12B
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Gemma 2 27b It
Gemma · ThomasBaruzier
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Zero Gemma4 E4B OpenZero
Gemma · shafire
Params7.5B
Context128K
Smallest5.9 GB
Tool use
GE
Gemma 2 Ataraxy 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12B It Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Coding
GE
Gemma 4 26B A4B Preserving Abliteration
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 3 Uncensored_v2 Merged
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
gemma4 comfyui mcp
Gemma · artokun
Params11.9B
Context128K
Q4_K_M3.4 GB
CodingTool use
GE
Fallen Gemma3 27B V1C
Gemma · TheDrummer
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 4 A4B 98e v6 Coder It
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M10.6 GB
CodingVision
GE
Gemma 4 E4B Abliterated Uncensored
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Roleplay
GE
gemma 4 E2B it QAT
Gemma · lmstudio-community
Params4.63B
Context128K
Smallest3.3 GB
Vision
GE
Gemma 4 E4B It GMCE
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma2 9b Neuro sama Q4 K M
Gemma · neifuisan
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Instinct Python Coder Gemma4 12B Qwen3.8 27B
Gemma · projectj
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
GE
Gemma 4 12B It Heretic
Gemma · SC117
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Huihui gemma 4 31B it abliterated v2
Gemma · groxaxo
Params30.7B
Context—
Smallest0.0 GB
GGUF
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 26B A4B It ARA Heresy
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 3 12b It Vl Minimax M2.1 Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision

Keep browsing