Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma2 gutenberg 27B
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3 1b It
Gemma · second-state
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 E4B It Abliterix
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 2 9B It SPPO Iter3
Gemma · MCZK
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 31B It Uncensored MAX
Gemma · prithivMLmods
Params30.7B
Context256K
Smallest32.6 GB
GE
Gemma4 12B Uncensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma 4 E4B Agentic Opus Reasoning GeminiCLI
Gemma · deadbydawn101
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
BugTraceAI Apex G4 26B Q4
Gemma · BugTraceAI
Params25.2B
Context256K
Smallest16.8 GB
GE
Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced
Gemma · CCSSNE
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 31B it abliterated
Gemma · wangzhang
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E4B It OBLITERATED
Gemma · rdhorner
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 Sphinsikus Chronist V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · llmfan46
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
DeskForge Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 12b It Vl GPT 5.1 High Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
shamrock 0 e4b
Gemma · oxalis-ink
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 26B A4B It Heretic Ara
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 12b It Vl GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
FuseChat Gemma 2 9B Instruct
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 12B Agentic Fable5 Composer2.5 v2 3.5x Tau2 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 E2B it Hi Fi
Gemma · fraQtl
Params4.65B
Context128K
Q4_K_M3.5 GB
GE
Gemma 3 12b It Vl GLM 4.7 Flash INSTRUCT Thinking Hybrid Heretic Uncensored
Gemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
Gemma 2 9b It WPO HB
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 12b It 3MPER0RR Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · QuantFactory
Params2.6B
Context8K
Q4_K_M1.7 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Chobrr
Params7.5B
Context128K
Q4_K_M5.3 GB