Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · bullerwins
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 E2B it qat MTP
Gemma · magnitudedev
Params77M
Context128K
Smallest0.1 GB
GE
Gemma 4 E4B It Ultra Uncensored Heretic
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 E4B It The DECKARD Expresso Universe HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 12b It
Gemma · DavidAU
Params11.8B
Context128K
Q4_K_M8.5 GB
GE
Gemma 4 26B A4B It Qat
Gemma · prithivMLmods
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma-4-E4B-It
Gemma · Hlebek
Params7.52B
Context128K
Q4_K_M5.0 GB
GE
Gemini Nano Gemmafied
Gemma · mradermacher
Params3.24B
Context8K
Q4_K_M2.1 GB
GE
Locus Gemma 4 E2B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 Garnet 31B It Uncensored Heretic
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Sakura Gemma4 E2B EmbeddingGemma2 DualMode
Gemma · webmp3
Params4.65B
Context128K
Smallest3.6 GB
GE
Huihui Gemma 4 12B Agentic Fable5 Abliterated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 3 1b It Heretic Extreme Uncensored Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma The Writer J.GutenBerg 10B
Gemma · DavidAU
Params10B
Context8K
Q4_K_M6.2 GB
GE
Gemma 4 31B It DFlash
Gemma · Anbeeld
Params1.54B
Context256K
Q4_K_M0.9 GB
GE
gemma-4-12B-it
Gemma · Mungert
Params11.9B
Context256K
Q4_K_M7.7 GB
GE
Amoral Gemma3 4B
Gemma · bartowski
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 9b It
Gemma · duyntnet
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Baihua Gemma4 E4B
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 4 31B It Assistant
Gemma · AtomicChat
Params470M
Context256K
Q4_K_M0.4 GB
GE
Gemma 4 Rust Coder
Gemma · MassivDash
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
gemma3
Gemma · libretranslate
Params11.8B
Context32K
Smallest1.0 GB
GE
Gemma 4 E2B it qat NVFP4
Gemma · WhiskyAKM
Params4.63B
Context128K
Smallest0.1 GB
GE
Gemma 4 12b Heretic Styletune Head
Gemma · mradermacher
Params12.9B
Context128K
Q4_K_M7.9 GB
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 4 26B A4B StyleTune V2 QAT
Gemma · alexisStacksCode
Params25.2B
Context128K
Smallest0.3 GB
GE
Gemma 3 4b It Uncensored DBL X
Gemma · mradermacher
Params4.26B
Context128K
Q4_K_M2.7 GB
GE
lei HuggingFace Gemma 2 9B 4bit Chat Level Measurement Guide 07242024
Gemma · RichardErkhov
Params3.4B
Context—
Q4_K_M1.7 GB
GE
Gemma 4 12B It QAT SOMPOA Heresy
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB