Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 3 12b It MPOA v2 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma 4 E2B it qat q4 0
Gemma · gg-hf-qat
Params4.63B
Context128K
Smallest3.3 GB
GE
Gemma 4 12B Hephaestus
Gemma · thesamgodson
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
gemma-2b
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.5 GB
GE
google gemma 2 2b GGUF smashed
Gemma · PrunaAI
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
gemma 4 E2B pocket mechanic
Gemma · MindFreakGamer
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 Orthia 31B IQ4 XS
Gemma · mkzz127
Params32.1B
Context256K
Smallest0.0 GB
GE
Lojistik Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
gemma-7b-English-to-Hinglish
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
FuseChat Gemma 2 9B Instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 E4B It
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M4.4 GB
GE
gemma2-9B-daybreak-v0.5
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gigantes v1 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemmasutra Pro 27B V1F
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Dante 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 e4b it iq1 s
Gemma · mrysh
Params7.52B
Context128K
Smallest3.1 GB
GE
Gemma-4-26B-A4B-It-Japanese
Gemma · JMingo
Params19.3B
Context256K
Q4_K_M13.1 GB
GE
gemma4 26B opus reasoning
Gemma · rico03
Params25.2B
Context256K
Smallest12.2 GB
GE
Gemma 3 27b It Uncensored
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma3 4b Tolkien
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
unsloth gemma 4 E4B it aia
Gemma · ragheb89
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 2 9b instruct
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GE
cve cwe gemma4 12b
Gemma · exploitintel
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
vaniebermudez gemma 2b instruct ft squad qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma 4 E2B it ARA Abliterated ik llama.cpp
Gemma · Austriani
Params4.63B
Context128K
Smallest2.5 GB
GE
gemma 4 31B it Q4 K local Q6 K global
Gemma · DZgas
Params30.7B
Context128K
Smallest0.3 GB
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · jaromer
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 12B it
Gemma · liodon-ai
Params11.9B
Context256K
Q4_K_M7.4 GB