Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 12b It MPOA v2 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma 4 E2B it qat q4 0
Gemma · gg-hf-qat
Params4.63B
Context128K
Smallest3.3 GB
ReasoningTool useVision
GE
Gemma 4 12B Hephaestus
Gemma · thesamgodson
Params11.9B
Context128K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
gemma-2b
Gemma · brittlewis12
Params2.51B
Context8K
Q4_K_M1.5 GB
GGUF
GE
google gemma 2 2b GGUF smashed
Gemma · PrunaAI
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 4 E2B pocket mechanic
Gemma · MindFreakGamer
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 4 Orthia 31B IQ4 XS
Gemma · mkzz127
Params32.1B
Context256K
Smallest0.0 GB
GGUF
GE
Lojistik Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma-7b-English-to-Hinglish
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
FuseChat Gemma 2 9B Instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 E4B It
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M4.4 GB
GGUF
GE
gemma2-9B-daybreak-v0.5
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gigantes v1 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemmasutra Pro 27B V1F
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Dante 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 e4b it iq1 s
Gemma · mrysh
Params7.52B
Context128K
Smallest3.1 GB
ReasoningTool useVision
GE
Gemma-4-26B-A4B-It-Japanese
Gemma · JMingo
Params19.3B
Context256K
Q4_K_M13.1 GB
ReasoningTool use
GE
gemma4 26B opus reasoning
Gemma · rico03
Params25.2B
Context256K
Smallest12.2 GB
ReasoningTool useVision
GE
Gemma 3 27b It Uncensored
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma3 4b Tolkien
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
unsloth gemma 4 E4B it aia
Gemma · ragheb89
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 2b
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 2 9b instruct
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
cve cwe gemma4 12b
Gemma · exploitintel
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
vaniebermudez gemma 2b instruct ft squad qa
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 E2B it ARA Abliterated ik llama.cpp
Gemma · Austriani
Params4.63B
Context128K
Smallest2.5 GB
EmbeddingReasoningRoleplay
GE
gemma 4 31B it Q4 K local Q6 K global
Gemma · DZgas
Params30.7B
Context128K
Smallest0.3 GB
Vision
GE
Gemma4-26B-A4B-Uncensored-HauhauCS-Balanced
Gemma · jaromer
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
GE
gemma 4 12B it
Gemma · liodon-ai
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use

Keep browsing