GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E2B It Heretic v1
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
gemma 4 E2B Gemini 3.1 Pro Reasoning Distill
Gemma · Ayodele01
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 2 27B Chinese Chat
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3 1b It Abliterated v2
Gemma · mlabonne
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 2 2b It
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GE
Gemma 2 2B Opus Instruct i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 2 9b
Gemma · fedric95
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 27b It
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SE
SEX_ROLEPLAY 2B
Sex · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
OR
Orion Kitchoon 26B A4B
Orion · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 1b Pt
Gemma · gguf-org
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma4 E4B TIES 3mask R64
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
RiverCub Gemma 3 27B Impotent Heresy
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 3 270m it
Gemma · Open4bits
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 3 270m
Gemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
GE
Gemma4_E2B_Abliterated_Opus_Distilled
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
EP
EpistemeAI codegemma 2 9b i1
Epistemeai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 E4B Luchador Rudo
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E4B It Abliterated
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
gemma-2-27b-it
Gemma · qwp4w3hyb
Params27.2B
Context8K
Smallest6.1 GB
GE
Gemma 3 27B Roblox Luau
Gemma · Alevnokc
Params28.4B
Context128K
Q4_K_M17.3 GB
GE
gemma-2-9b-it
Gemma · second-state
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 E2B It Saber
Gemma · DJLougen
Params4.63B
Context128K
Q4_K_M3.4 GB
YA
YanoljaNEXT Rosetta 27B 2511
Yanoljanext · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
GE
EZO Humanities 9B gemma 2 it
Gemma · MCZK
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It Biprojected Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CO
codegemma-1.1-7b-it
Codegemma · lmstudio-community
Params8.54B
Context8K
Q4_K_M5.3 GB
OB
oblivionsend i1
Oblivionsend · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
26B A4B
Gemma · kingjones777
Params25.2B
Context256K
Smallest0.5 GB