Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
CodingReasoningRoleplay
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · Acelogicdev
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 4 E4B It Uncensored MAX Opus 4.7
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 4 E4B Q4 K M
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 E4B Abliterated
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M5.3 GB
Coding
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma-4-26B-A4B-It-Ultra-Uncensored-Heretic
Gemma · JMingo
Params25.2B
Context256K
Q4_K_M16.9 GB
GGUF
GE
lyrics room suno director v4
Gemma · rambrogi
Params11.9B
Context256K
Smallest12.7 GB
ReasoningTool use
GE
models--google--gemma-7b
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 4 E2B It GMCE
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 4 E4B It Assistant
Gemma · AtomicChat
Params78M
Context128K
Q4_K_M0.1 GB
GGUF
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
GGUF
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma-4-12B
Gemma · ggml-org
Params11.9B
Context256K
Smallest12.7 GB
GGUF
GE
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
Reasoning
GE
gemma 4 E4B it SDFT Heretic RP
Gemma · Ilya626
Params7.5B
Context128K
Q4_K_M5.3 GB
RoleplayVision
GE
GemmaDGAF 2B
Gemma · hecan3d
Params2.6B
Context8K
Q4_K_M1.7 GB
Roleplay
GE
gemma 2 2b it Flight Multi Turn V3 DPO
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma 4 A4B 98e v5 Coder It
Gemma · mradermacher
Params19.9B
Context256K
Q4_K_M13.2 GB
Coding
GE
gemma 4 A4B 98e v7 coderx it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
CodingVision
GE
Gemma 4 12B It Heretic NVFP4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
Vision
GE
Gemma 4 31B It Scotoma 2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningVision
GE
Gemma 4 12B it QAT NVFP4
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest7.2 GB
Vision
GE
Gemma 4 12B It Qat
Gemma · dahara1
Params11.9B
Context256K
Q4_K_M7.1 GB
Vision

Keep browsing