Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
gemma 7b
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 31B it qat q4 0
Gemma · google
Params30.7B
Context256K
Smallest17.7 GB
GE
Gemma 4 E2B
Gemma · lmstudio-community
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma-3-12B-It-Qat
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 26B A4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 12b It Uncensored
Gemma · zaakirio
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
gemma 2b
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GE
gemma 4 12b heretic abliterated
Gemma · culturerevolt
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · llmfan46
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 1b It
Gemma · lmstudio-community
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params4.65B
Context128K
Smallest3.0 GB
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 4b It
Gemma · ggml-org
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 31B It Abliterated
Gemma · paperscarecrow
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Google_Gemma 4 31B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params30.7B
Context256K
Smallest17.7 GB
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
GE
gemma-4-12B-it
Gemma · ggml-org
Params11.9B
Context256K
Smallest0.3 GB
GE
gemma 4 E2B it qat
Gemma · unsloth
Params4.63B
Context128K
Smallest0.1 GB
GE
Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
GE
Gemma 4 26B A4B
Gemma · lmstudio-community
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 E4B it qat mobile
Gemma · unsloth
Params7.46B
Context128K
Smallest0.1 GB
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma-3-12B-It
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 4b It
Gemma · lmstudio-community
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Winnow 12B
Gemma · EldanRing
Params423M
Context256K
Smallest0.9 GB
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB