Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 14B A4B Heretic v2
Gemma · blascotobasco
Params13.8B
Context256K
Q4_K_M9.2 GB
ReasoningTool useVision
GE
Gemini 3.1 Pro Gemma 4 E4B Distill
Gemma · thomasdg190
Params7.52B
Context128K
Q4_K_M5.3 GB
Reasoning
GE
evilguytest
Gemma · anyalkonsafe
Params7.52B
Context128K
Smallest5.3 GB
ReasoningVision
GE
Gemma 4 E2B Portfolio IT
Gemma · SRafi007
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 4 E4B it Ultra Uncensored Heretic NVFP4
Gemma · FreedomAISVR
Params7.52B
Context128K
Smallest5.2 GB
ReasoningTool useVision
GE
Gemma 4 E4B It OBLITERATED
Gemma · Centara
Params7.46B
Context128K
Smallest8.0 GB
GGUF
GE
Gemma 4 12b Marvin v1
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · Hjsfhdu
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma SEA LION v3 9B IT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 27b It
Gemma · duyntnet
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
MamayLM Gemma 3 4B IT v1.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Rombo LLM V2.7 gemma 2 9b i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 26B A4B It Speculator.Eagle3
Gemma · williamliao
Params928M
Context256K
Q4_K_M0.6 GB
ReasoningTool use
GE
Aidc Llm Laos 10k Gemma 3 12b It
Gemma · Phonepadith
Params12.8B
Context128K
Smallest6.3 GB
GGUF
GE
Gemma 3 12b Pt Conductivity
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 4 12B It Esper4Tachibana
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Turkish Gemma 9b v0.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E4B It QAT SOMPOA Heresy
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 3b 002
Gemma · RichardErkhov
Params3.17B
Context8K
Q4_K_M2.0 GB
GGUF
GE
Gemma3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Ndizi Gemma4 E2B African Asr Merged
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
gemma 3 12b instruct
Gemma · lm-kit
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 4b It Heretic Creative
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 2 9b Chatml
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Meditron3 Gemma2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
OpenHermes Gemma 2B i1
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
Tool use
GE
gemma 4 26B A4B it
Gemma · ruygar
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
gemma 4 31b abliterated v1.1
Gemma · Kooten
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
gemma-2b-translation-v0.150
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Keep browsing