GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
EM
Embeddinggemma 300m Qat Q8_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
EM
Embeddinggemma 300m
Embeddinggemma · ente-ai
Params308M
Context2K
Smallest0.3 GB
GE
gemma-2-9b-it
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It
Gemma · lmstudio-community
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · OBLITERATUS
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
gemma 7b it
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
GE
supergemma4 26b uncensored gguf v2
Gemma · Jiunsong
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Andycurrent
Params1B
Context32K
Q4_K_M0.8 GB
GE
gemma 4 26B A4B it heretic APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 1b It
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
TR
Translategemma 12b It
Translategemma · bullerwins
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 12B It Heretic
Gemma · igorls
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma-4-26B-A4B-It
Gemma · mudler
Params25.2B
Context256K
Smallest9.5 GB
GE
gemma 2b it
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Q4_K_M7.3 GB
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
gemma 4 26B A4B it Claude Opus Distill APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
SP
Spectre 37B v1a
Spectre · BeaverAI
Params36.6B
Context256K
Q4_K_M22.2 GB
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · douyamv
Params30.7B
Context256K
Q4_K_M18.7 GB
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
GE
google gemma 3 12b it qat q4 0 gguf small fix
Gemma · Dampfinchen
Params11.8B
Context128K
Smallest6.9 GB
GE
Gemma 3 27b It
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
SO
Sommerfugl 31b v2
Sommerfugl · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB