GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
SP
Spectre 37B v1a GGUF Dirty
Spectre · BeaverAI
Params36.6B
Context256K
Q4_K_M22.2 GB
GE
Gemma 3 12b It Abliterated
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma-1.1-7b-it
Gemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
gemma-2-9b-it
Gemma · lmstudio-community
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 270m It Qat Q4_0 Unquantized
Gemma · ggml-org
Params268M
Context32K
Smallest0.2 GB
GE
Gemma 3 12b It Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
GE
Gemma 3 1b
Gemma · lmstudio-community
Params1B
Context32K
Smallest0.7 GB
GE
Gemma 3 1b It Abliterated
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 270m It
Gemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
GE
Gemma 3 12b It Abliterated v2
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
DA
datagemma rig 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GE
Gemma 3n E4B It
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
GE
gemma 3n E4B it text
Gemma · lmstudio-community
Params6.9B
Context32K
Q4_K_M4.2 GB
GE
Gemma 3 4b It Qat
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 E4B xReadable zhTW OCR v1
Gemma · xCloudinfo
Params7.46B
Context128K
Q4_K_M5.3 GB
RU
Rumeni 26B A4B
Rumeni · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · kamjin
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3n E2B It
Gemma · bartowski
Params4.46B
Context32K
Q4_K_M2.8 GB
SH
Shadow-Siren-14B-v2-Pruned
Shadow · mradermacher
Params13.8B
Context256K
Q4_K_M9.2 GB
GE
t5gemma-b-b-ul2 tokenizer (Gemma BPE)
Gemma · thepatch
Params282M
Context—
Smallest0.0 GB
GE
Gemma-3-270M-It-Qat
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma 3 27b It
Gemma · ggml-org
Params27B
Context128K
Q4_K_M16.5 GB
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
GL
Glitter_Boy 2.0
Glitter · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
gemma-2-9b-it
Gemma · legraphista
Params9.24B
Context8K
Smallest2.4 GB
BO
Boulesis v2.1 26B A4B HeadTune
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
GE
Mahou-1.3-gemma2-9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB