GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TU
Tucan 27B v1.0
Tucan · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
Tool use
GE
Gemma 2 2B Stheno Filtered i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 4b It Uncensored v2
Gemma · Andycurrent
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
DA
Dark Pane
Dark · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MA
magnum v4 27b
Magnum · anthracite-org
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma 4 E4B Agentic Sol Fable Reasoning GeminiCLI
Gemma · deadbydawn101
Params7.5B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 3 27b It Abliterated Refined Vision
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 27b It
Gemma · chatpig
Params27B
Context128K
Q4_K_M16.5 GB
Vision
KI
Kitchoon 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
GE
gemma-2b-it
Gemma · codegood
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 3 4b It
Gemma · second-state
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 4 19b A4B It REAP Heretic
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
Coding
GE
Gemma 3 12B FornaxV.2 QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningRoleplayVision
TR
Translategemma 4b It
Translategemma · NikolayKozloff
Params3.88B
Context128K
Smallest4.1 GB
Vision
SH
Shieldgemma 27b
Shieldgemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
GE
OpenYourMind Gemma4 12B IT Abliterated
Gemma · DuoNeural
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
GE
EZO Common T2 2B Gemma 2 It
Gemma · mmnga
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DA
datagemma rag 27b it IMat
Datagemma · legraphista
Params27.2B
Context8K
Smallest6.1 GB
GGUF
BO
Boulesis 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
MA
Magnum v3 27b Kto
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Amoral Fallen Omega Gemma3 12B
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
Gemma 3 12b It Heretic v2
Gemma · Medvedko
Params11.8B
Context128K
Q4_K_M7.3 GB
Coding
DA
datagemma rag 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma2 gutenberg 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
QW
Cyberneurova Qwen3.8 Flash Next
Qwen · spiritfather
Params177B
Context256K
Q4_K_M119.2 GB
GGUF
GE
Gemma 4 19b A4B It REAP
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
GGUF
GE
EZO-Common-9B-gemma-2-it
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · klh23
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
GE
Gemma 3 27B Derestricted
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF

Keep browsing