Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma-4-26B-A4B-It
Gemma · mudler
Params25.2B
Context256K
Smallest9.5 GB
GE
gemma 2b it
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GE
Gemma 4 Orthia 31B
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
GE
Gemma 4 31B It Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · Andycurrent
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
G.E.M-Strike
Gemma · UltimateIntent
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma The Writer N Restless Quill 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.1 GB
GE
gemma 4 12B it uncensored
Gemma · TrevorJS
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 12B it heretic QAT
Gemma · SC117
Params11.9B
Context256K
Smallest6.7 GB
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma4 12b with proj ltx 2.5
Gemma · elix3r
Params13.1B
Context—
Q4_K_M8.4 GB
GE
Gemma 4 31B StyleTune
Gemma · bartowski
Params32.1B
Context256K
Q4_K_M20.4 GB
GE
gemma 4 26B A4B it Claude Opus Distill APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
GE
gemma-4-E4B-it
Gemma · TheStageAI
Params7.46B
Context128K
Q4_K_M4.3 GB
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · douyamv
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemmasutra Mini 2B v1
Gemma · TheDrummer
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
google gemma 3 12b it qat q4 0 gguf small fix
Gemma · Dampfinchen
Params11.8B
Context128K
Smallest6.9 GB
GE
Gemma 4 31B It Abliterated
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 27b It
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 4 E4B it heretic
Gemma · Abiray
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 31B Fable Coder
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 Writers 31B V2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Ablation 188 Gemma3.Webnovels.Test.Gemma 3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
avemio digital gemma 2b Sft pretrain 6000 steps merge
Gemma · RichardErkhov
Params2.5B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 E2B it
Gemma · AtomicChat
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2 9b It
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 27b It Abliterated
Gemma · mlabonne
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 27b It Qat
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 12b It Heretic v2
Gemma · DreamFast
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
ThinkingCap gemma 4 26B A4B it
Gemma · bottlecapai
Params25.2B
Context256K
Q4_K_M17.0 GB