GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma-3N-E4B-It
Gemma · unsloth
Params6.9B
Context32K
Q4_K_M4.5 GB
Vision
EM
Embeddinggemma 300m Qat Q8_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
Embedding
GE
Gemma 2 2b It
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
EM
Embeddinggemma 300m
Embeddinggemma · ente-ai
Params308M
Context2K
Smallest0.3 GB
Embedding
GE
gemma-2-9b-it
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · lmstudio-community
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · OBLITERATUS
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
GE
gemma 7b it
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
GGUF
GE
supergemma4 26b uncensored gguf v2
Gemma · Jiunsong
Params25.2B
Context256K
Q4_K_M16.8 GB
Tool use
GE
Gemma 3 1B It GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · Andycurrent
Params1B
Context32K
Q4_K_M0.8 GB
Reasoning
GE
gemma 4 26B A4B it heretic APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
CodingVision
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma-3-4B-It-Qat
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
KI
Kitchoon V3 26B A4B
Kitchoon · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
GE
Gemma 3 12b It
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 1b It
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
TR
Translategemma 12b It
Translategemma · bullerwins
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 12B It Heretic
Gemma · igorls
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
GE
Gemma-4-26B-A4B-It
Gemma · mudler
Params25.2B
Context256K
Smallest9.5 GB
Vision
GE
gemma 2b it
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GGUF
GE
Gemma 3 12b It
Gemma · ggml-org
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
BO
Boulesis v2.1 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
gemma 4 26B A4B it Claude Opus Distill APEX
Gemma · mudler
Params25.2B
Context256K
Smallest13.0 GB
Vision
SP
Spectre 37B v1a
Spectre · BeaverAI
Params36.6B
Context256K
Q4_K_M22.2 GB
GGUF
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · douyamv
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
EM
Embeddinggemma 300m Qat Q4_0 Unquantized
Embeddinggemma · unsloth
Params303M
Context2K
Smallest0.3 GB
Embedding
GE
google gemma 3 12b it qat q4 0 gguf small fix
Gemma · Dampfinchen
Params11.8B
Context128K
Smallest6.9 GB
Vision
GE
Gemma 3 27b It
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SO
Sommerfugl 31b v2
Sommerfugl · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF

Keep browsing