Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
openchat 3.5 0106 gemma i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
gemma 4 31B it scotoma
Gemma · ReadyArt
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
Amoral Gemma3 4B v2 Qat
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Bbuddy v2 Gemma3 4B Nsfw HF
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 4 26B A4B It
Gemma · grapeV-ai
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Eunoia Gemma 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 12b It Misogyny
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 27b Pt LucyV1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 12b It Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 31b nomDePlume
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
silent_voice_multimodal_model
Gemma · 0xroyce
Params6.87B
Context32K
Smallest7.3 GB
GE
ecdev gemma 2b instruct ft medical qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Ko Gemma 2 9b It
Gemma · KIST-robot-intelligence
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Atlasv13 Gemma4 26b
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 12b It Qat Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
EZO-Humanities-9B-gemma-2-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 Harmonia 31B
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
MT1 Gen2 MMMU gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 3 270m instruct
Gemma · lm-kit
Params268M
Context32K
Q4_K_M0.3 GB
GE
gemma-2-9b-it
Gemma · zhezhe
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma-2b-it
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
EX Ai1 3.88B Gemma3
Gemma · EXAiStudio
Params3.88B
Context128K
Smallest2.5 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · minte1431
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
abdulmannan 01 gemma 2 2b finetuned for json generation
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Text To Cypher Gemma 3 4B Instruct 2025.04.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 4 26B A4B Claude Opus 4.7 QAT Q4 0 Heretic
Gemma · DFveloper
Params25.2B
Context256K
Smallest14.4 GB
GE
Gemma 4 12B It Desiccated
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
gemma-2b-it-tamil-v0.1-alpha
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
translate gemma 4 sub e2b
Gemma · 17slever17
Params4.65B
Context128K
Smallest0.1 GB
GE
Ariane_Gemma
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB