Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
gemma 7b
Gemma · google
Params8.54B
Context—
Smallest34.2 GB
GGUF
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · yuxinlu1
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
GE
gemma 4 31B it qat q4 0
Gemma · google
Params30.7B
Context256K
Smallest17.7 GB
Vision
GE
Gemma 4 E2B
Gemma · lmstudio-community
Params4.65B
Context128K
Q4_K_M3.4 GB
Vision
GE
Gemma-3-12B-It-Qat
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 26B A4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 4 12b It Uncensored
Gemma · zaakirio
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
GE
gemma 2b
Gemma · google
Params2.51B
Context—
Smallest10.0 GB
GGUF
GE
gemma 4 12b heretic abliterated
Gemma · culturerevolt
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · llmfan46
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma 3 1b It
Gemma · lmstudio-community
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma-3-270M-It
Gemma · unsloth
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · HauhauCS
Params4.65B
Context128K
Smallest3.0 GB
Vision
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · HauhauCS
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma 3 4b It
Gemma · ggml-org
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 31B It Abliterated
Gemma · paperscarecrow
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Google_Gemma 4 31B It Qat Q4_0 Unquantized
Gemma · lmstudio-community
Params30.7B
Context256K
Smallest17.7 GB
Vision
GE
gemma 4 31B it qat
Gemma · unsloth
Params480M
Context128K
Smallest0.3 GB
Vision
GE
gemma-4-12B-it
Gemma · ggml-org
Params11.9B
Context256K
Smallest0.3 GB
ReasoningTool useVision
GE
gemma 4 E2B it qat
Gemma · unsloth
Params4.63B
Context128K
Smallest0.1 GB
Vision
GE
Gemma 4 26B A4B It
Gemma · bartowski
Params25.2B
Context256K
Q4_K_M17.0 GB
Vision
GE
Gemma 4 26B A4B
Gemma · lmstudio-community
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
gemma 4 E4B it qat mobile
Gemma · unsloth
Params7.46B
Context128K
Smallest0.1 GB
Vision
GE
Gemma 4 Ortenzya The Creative Wordsmith 31B It Uncensored Heretic
Gemma · llmfan46
Params30.7B
Context256K
Q4_K_M18.7 GB
RoleplayVision
GE
Gemma-3-12B-It
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 4b It
Gemma · lmstudio-community
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Winnow 12B
Gemma · EldanRing
Params423M
Context256K
Smallest0.9 GB
Vision
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
Vision

Keep browsing