Gemma GGUF models
13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.
GE
Gemma 4 14B A4B Heretic v2
Gemma · blascotobasco
Params13.8B
Context256K
Q4_K_M9.2 GB
GE
Gemini 3.1 Pro Gemma 4 E4B Distill
Gemma · thomasdg190
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
evilguytest
Gemma · anyalkonsafe
Params7.52B
Context128K
Smallest5.3 GB
GE
Gemma 4 E2B Portfolio IT
Gemma · SRafi007
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 4 E4B it Ultra Uncensored Heretic NVFP4
Gemma · FreedomAISVR
Params7.52B
Context128K
Smallest5.2 GB
GE
Gemma 4 E4B It OBLITERATED
Gemma · Centara
Params7.46B
Context128K
Smallest8.0 GB
GE
Gemma 4 12b Marvin v1
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · Hjsfhdu
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma SEA LION v3 9B IT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 3 27b It
Gemma · duyntnet
Params27B
Context128K
Q4_K_M16.5 GB
GE
MamayLM Gemma 3 4B IT v1.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Rombo LLM V2.7 gemma 2 9b i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 26B A4B It Speculator.Eagle3
Gemma · williamliao
Params928M
Context256K
Q4_K_M0.6 GB
GE
Aidc Llm Laos 10k Gemma 3 12b It
Gemma · Phonepadith
Params12.8B
Context128K
Smallest6.3 GB
GE
Gemma 3 12b Pt Conductivity
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 4 12B It Esper4Tachibana
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Turkish Gemma 9b v0.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 4 E4B It QAT SOMPOA Heresy
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3b 002
Gemma · RichardErkhov
Params3.17B
Context8K
Q4_K_M2.0 GB
GE
Gemma3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Ndizi Gemma4 E2B African Asr Merged
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
gemma 3 12b instruct
Gemma · lm-kit
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 4b It Heretic Creative
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 2 9b Chatml
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Meditron3 Gemma2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
OpenHermes Gemma 2B i1
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
gemma 4 26B A4B it
Gemma · ruygar
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
gemma 4 31b abliterated v1.1
Gemma · Kooten
Params30.7B
Context256K
Q4_K_M18.7 GB
GE
gemma-2b-translation-v0.150
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB