Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma2 gutenberg 27B
Gemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 1b It
Gemma · second-state
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 4 E4B It Abliterix
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2 9B It SPPO Iter3
Gemma · MCZK
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12B It Esper4
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Reasoning
GE
Gemma 4 31B It Uncensored MAX
Gemma · prithivMLmods
Params30.7B
Context256K
Smallest32.6 GB
ReasoningVision
GE
Gemma4 12B Uncensored
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
gemma 4 E4B Agentic Opus Reasoning GeminiCLI
Gemma · deadbydawn101
Params7.5B
Context128K
Q4_K_M5.3 GB
CodingReasoningTool use
GE
BugTraceAI Apex G4 26B Q4
Gemma · BugTraceAI
Params25.2B
Context256K
Smallest16.8 GB
ReasoningTool use
GE
Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced
Gemma · CCSSNE
Params25.2B
Context256K
Q4_K_M16.8 GB
RoleplayVision
GE
gemma 4 31B it abliterated
Gemma · wangzhang
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma 4 E4B It OBLITERATED
Gemma · rdhorner
Params7.5B
Context128K
Q4_K_M5.3 GB
Tool useVision
GE
Gemma 4 Sphinsikus Chronist V2 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
Gemma 4 E4B It Uncensored Heretic
Gemma · llmfan46
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
DeskForge Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma 3 12b It Vl GPT 5.1 High Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
shamrock 0 e4b
Gemma · oxalis-ink
Params7.46B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma 4 26B A4B It Heretic Ara
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 3 12b It Vl GLM 4.7 Flash Heretic Uncensored Thinking
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
FuseChat Gemma 2 9B Instruct
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12B Agentic Fable5 Composer2.5 v2 3.5x Tau2 Uncensored Heretic
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 4 E2B it Hi Fi
Gemma · fraQtl
Params4.65B
Context128K
Q4_K_M3.5 GB
ReasoningTool use
GE
Gemma 3 12b It Vl GLM 4.7 Flash INSTRUCT Thinking Hybrid Heretic Uncensored
Gemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
ReasoningVision
GE
Gemma 2 9b It WPO HB
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12b It 3MPER0RR Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
Vision
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · QuantFactory
Params2.6B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Chobrr
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision

Keep browsing