GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma2 Nephilim v3 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 26B A4B It Uncensored
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma 4 A4B 98e v5 Coder It
Gemma · mradermacher
Params19.9B
Context256K
Q4_K_M13.2 GB
CodingVision
GE
Gemma4 31b Gembrain Equinox
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Roleplay
GE
Barcenas Gemma 2 9b i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma2 9b WangchanLIONv2 instruct i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Heretic X
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Jevify Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
GE
gemma 3 1b it qat q4 0
Gemma · google
Params1B
Context32K
Smallest1.0 GB
GGUF
GE
Gemma 4 26B A4B Abliterated
Gemma · DuoNeural
Params25.2B
Context256K
Smallest13.3 GB
ReasoningTool use
GE
Gemma 3 12b It Ultra Uncensored Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 E4B It Abliterated
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 3 12b It Uncensored
Gemma · Andycurrent
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
SI
SILMA 9B Instruct v1.0 i1
Silma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MamayLM Gemma 3 12B IT v1.0
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
LL
Gemma 2 Llama Swallow 9b It v0.1 Heretic
Llama · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-3-4B-It-Qat-Int4
Gemma · unsloth
Params3.88B
Context128K
Q4_K_M2.3 GB
Vision
IR
Irodori-TTS-v4-Large
Irodori · sakasegawa
Params3.38B
Context—
Smallest2.6 GB
GGUF
RU
Rumeni 26B A4B
Rumeni · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
Bella Bartender Gemma E4B Src
Gemma · juiceb0xc0de
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
FU
Functiongemma 270m It
Functiongemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
Tool use
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma 4 e4b hindi instruct
Gemma · pankajpandey-dev
Params7.52B
Context128K
Q4_K_M5.3 GB
Reasoning
CO
codegemma-7b-it
Codegemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
MI
Mira v1.23 27B Rlvr
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b Pt
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 4 31B Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
TU
turkish pii detection
Turkish · halilneed
Params268M
Context32K
Smallest0.3 GB
GGUF
CO
codegemma-2b
Codegemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
BA
BartaLens E2B
Bartalens · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF

Keep browsing