Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Wicked Stuff 31B Final
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma-3N-E2B-It
Gemma · unsloth
Params4.46B
Context32K
Q4_K_M3.0 GB
GE
Gemmasutra Small 4B v1
Gemma · TheDrummer
Params3.86B
Context8K
Q4_K_M2.5 GB
GE
Gemma 4 E4B it Artemis
Gemma · turintech
Params7.46B
Context128K
Smallest0.1 GB
GE
Gemma 3 1b
Gemma · lmstudio-community
Params1B
Context32K
Smallest0.7 GB
GE
gemma4 E2B it qat Q4 unsloth heretic
Gemma · MobiusDevelopment
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma 3 1b It Abliterated
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
gemma 4 E4B it heretic
Gemma · saidutta69
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 3 270m It
Gemma · ggml-org
Params268M
Context32K
Smallest0.3 GB
GE
Gemma 3 12b It Abliterated v2
Gemma · mlabonne
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 12b It Vl Kimi V2 Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3n E4B It
Gemma · bartowski
Params6.9B
Context32K
Q4_K_M4.2 GB
GE
Gemma 4 26B A4B It Qat Q4_0 Uncensored Heretic
Gemma · llmfan46
Params25.2B
Context256K
Smallest16.0 GB
GE
gemma 3n E4B it text
Gemma · lmstudio-community
Params6.9B
Context32K
Q4_K_M4.2 GB
GE
Gemma 3 4b It Qat
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 Queen 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E4B xReadable zhTW OCR v1
Gemma · xCloudinfo
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Omega Arsenal 26B A4B Final
Gemma · ReadyArt
Params25.2B
Context256K
Q4_K_M17.7 GB
GE
Gemma 4 12B It Qat Q4_0 Uncensored Heretic v3
Gemma · OS-Software
Params11.9B
Context256K
Smallest6.7 GB
GE
Gemma 4 26b A4B Heretic
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 Dark Thoughts 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
GE
Gemma 3 4B VL It Gemini Pro Heretic Uncensored Thinking
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 31B StyleTune Heretic Ara
Gemma · mradermacher
Params32.1B
Context256K
Q4_K_M19.5 GB
GE
Gemma The Writer Mighty Sword 9B
Gemma · DavidAU
Params9.2B
Context8K
Q4_K_M5.6 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · kamjin
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 31B It Scotoma 2
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB