Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
gemma 4 12B it
Gemma · AtomicChat
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 4 E4B it
Gemma · AtomicChat
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 4 Novelist Eclipse 31B
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
Roleplay
GE
UNSEEN Gemma 4 26B NSFW
Gemma · Jommarn
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 26B A4B It Ultra Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · OBLITERATUS
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
GE
gemma 7b it
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
GGUF
GE
supergemma4 26b uncensored gguf v2
Gemma · Jiunsong
Params25.2B
Context256K
Q4_K_M16.8 GB
Tool use
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Andycurrent
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
GE
gemma 4 26B A4B it uncensored
Gemma · TrevorJS
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
gemma 4 26B A4B it heretic APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
CodingVision
GE
Gemma 4 12B Coder Fable5 Composer2.5 v1 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningVision
GE
gemma 4 E2B it uncensored
Gemma · TrevorJS
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Huihui gemma 4 E4B it qat q4 0 unquantized abliterated
Gemma · huihui-ai
Params7.46B
Context128K
Smallest0.2 GB
Vision
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Sprinkle Gemma 4 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
gemma-2b-it
Gemma · lmstudio-ai
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
GE
gemma 4 E4B it uncensored
Gemma · TrevorJS
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 E2B it LocalAI
Gemma · weareapexcreators
Params7.5B
Context128K
Q4_K_M5.0 GB
Vision
GE
Gemma 3 1b It
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma4 12B Uncensored LocalAI
Gemma · weareapexcreators
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Gemma 4 26B A4B StyleTune V2
Gemma · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
Roleplay
GE
Gemma 4 12B It Heretic
Gemma · igorls
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
GE
Gemory 26B A4B
Gemma · UltimateIntent
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
GE
Gemma 4 E2B It Ultra Uncensored Heretic
Gemma · llmfan46
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
GE
26B A4B
Gemma · terrorswift
Params25.2B
Context256K
Smallest0.5 GB
Vision
GE
Dark Scarlett v0.3 26B A4B
Gemma · ReadyArt
Params25.2B
Context256K
Q4_K_M16.8 GB
Roleplay
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding

Keep browsing