Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-4-26B-A4B-It
Gemma · mudler
Params25.2B
Context256K
Smallest9.5 GB
Vision
GE
gemma 2b it
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GGUF
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
Roleplay
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Coding
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · Andycurrent
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GE
G.E.M-Strike
Gemma · UltimateIntent
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Gemma The Writer N Restless Quill 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.1 GB
Roleplay
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Smallest6.7 GB
CodingVision
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma4 12b with proj ltx 2.5
Gemma · elix3r
Params13.1B
Context—
Q4_K_M8.4 GB
CodingEmbedding
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
Roleplay
GE
gemma 4 26B A4B it Claude Opus Distill APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
Vision
GE
gemma-4-E4B-it
Gemma · TheStageAI
Params7.46B
Context128K
Q4_K_M4.3 GB
GGUF
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · douyamv
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
google gemma 3 12b it qat q4 0 gguf small fix
Gemma · Dampfinchen
Params11.8B
Context128K
Smallest6.9 GB
Vision
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 3 27b It
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
gemma 4 E4B it heretic
Gemma · Abiray
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingVision
GE
Gemma 4 31B Fable Coder
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingTool useVision
GE
Gemma 4 Writers 31B V2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Ablation 188 Gemma3.Webnovels.Test.Gemma 3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
avemio digital gemma 2b Sft pretrain 6000 steps merge
Gemma · RichardErkhov
Params2.5B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 E2B it
Gemma · AtomicChat
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b It Abliterated
Gemma · mlabonne
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
GE
ThinkingCap gemma 4 26B A4B it
Gemma · bottlecapai
Params25.2B
Context256K
Q4_K_M17.0 GB
ReasoningTool useVision

Keep browsing