GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
ChaThai Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 12b It MPOA v2 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
DA
Dagger 12B_SFT
Dagger · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningVision
GE
google gemma 2 2b GGUF smashed
Gemma · PrunaAI
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 4 E2B pocket mechanic
Gemma · MindFreakGamer
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 4 E4B It
Gemma · DuoNeural
Params7.5B
Context128K
Q4_K_M4.4 GB
GGUF
EM
embeddinggemma-2
Embeddinggemma · webmp3
Params271M
Context256K
Smallest0.2 GB
Embedding
GE
Gigantes v1 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Dante 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
CA
Cascade Rlvr75 12B
Cascade · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
CA
Cascade Rlvr75 12B
Cascade · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
TU
TurboGemma4E2B
Turbogemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Rinna.Gemma 2 Baku 2b
Gemma · DevQuasar-10
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 26B A4B Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
MT Gen1 Gemma 3 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
MI
Mira v1.22.2 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
DA
DarkIdol Aria 12B
Darkidol · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
EM
Embeddinggemma 300m
Embeddinggemma · mradermacher
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
GE
Gemma 2 2b ORPO Jpn It Abliterated 18
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
ST
STARK 4B Thinking
Stark · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Gemma 1.1 7b It
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 3 4b It Heretic Logic
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3 4b It
Gemma · starust
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
SA
Safeword Casual v1 R1 4B
Safeword · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplay
DA
Darkidol Chasm 4B
Darkidol · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
GE
Gemma 4 26B A4B It
Gemma · pirola
Params25.2B
Context256K
Smallest14.0 GB
ReasoningTool use
QU
Quill v1 abliterated i1
Quill · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira V1.19.3C 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
DA
Darkest muse v1 abliterated
Darkest · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing