Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 4 12B It Uncensored Opus4.7 Cot
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 It Vl 40B Gemini Heretic Uncensored Thinking
Gemma · mradermacher
Params40B
Context128K
Q4_K_M24.5 GB
GE
gemma 4 12B agentic fable5 composer2.5 v2 3.5x tau2
Gemma · Acelogicdev
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 E4B It Uncensored MAX Opus 4.7
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E4B Q4 K M
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E4B Abliterated
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 12b RedTeam BlackICE
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma-4-26B-A4B-It-Ultra-Uncensored-Heretic
Gemma · JMingo
Params25.2B
Context256K
Q4_K_M16.9 GB
GE
lyrics room suno director v4
Gemma · rambrogi
Params11.9B
Context256K
Smallest12.7 GB
GE
models--google--gemma-7b
Gemma · MaziyarPanahi
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 4 E2B It GMCE
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 E4B It Assistant
Gemma · AtomicChat
Params78M
Context128K
Q4_K_M0.1 GB
GE
gemma-4-31B-it-uncensored-heretic
Gemma · JMingo
Params30.7B
Context256K
Q4_K_M18.3 GB
GE
Gemma 3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma-4-12B
Gemma · ggml-org
Params11.9B
Context256K
Smallest12.7 GB
GE
gemma-4-31B-Claude-4.6-Opus-Reasoning-Distilled
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
gemma 4 E4B it SDFT Heretic RP
Gemma · Ilya626
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
GemmaDGAF 2B
Gemma · hecan3d
Params2.6B
Context8K
Q4_K_M1.7 GB
GE
gemma 2 2b it Flight Multi Turn V3 DPO
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma 2 9b
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 31B It
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 A4B 98e v5 Coder It
Gemma · mradermacher
Params19.9B
Context256K
Q4_K_M13.2 GB
GE
gemma 4 A4B 98e v7 coderx it
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M13.2 GB
GE
Gemma 4 12B It Heretic NVFP4
Gemma · Magnarks
Params11.9B
Context256K
Smallest7.0 GB
GE
Gemma 4 31B It Scotoma 2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Gemma 4 26B A4B It Uncensored MAX
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 4 12B it QAT NVFP4
Gemma · FreedomAISVR
Params11.9B
Context256K
Smallest7.2 GB
GE
Gemma 4 12B It Qat
Gemma · dahara1
Params11.9B
Context256K
Q4_K_M7.1 GB