GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
QU
Quill v1 abliterated
Quill · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira V1.8.1B 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Coding
GE
Gemma 3 12b It Antislop De
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 2 27b It
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma4 turkish 26b a4b pruned
Gemma · webbrain-one
Params20.4B
Context256K
Q4_K_M13.6 GB
ReasoningTool useVision
GE
X-Ray_Alpha
Gemma · Mungert
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
ZO
Zombie 1B
Zombie · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
LU
lumichats_4Bz_v1.4
Lumichats · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
LL
Gemma 2 Llama Swallow 2b It v0.1 Heretic
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DA
datagemma rag 27b it
Datagemma · mmnga
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
RiverCub Gemma 3 27B
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma_Coder_9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
Coding
GE
gemma 7b
Gemma · LiteLLMs
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
SI
SILMA 9B Instruct v1.0
Silma · 0ssamaak0
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KO
Kofu 2B Edge
Kofu · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Text To Cypher Gemma 3 4B Instruct 2025.04.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 2 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
SahabatAI Lion 9B TIES v1
Gemma · gmonsoon
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SH
Shivneri Marathi Llm 7b v0.1
Shivneri · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma ko 7b instruct v0.71
Gemma · tensorblock
Params8.54B
Context8K
Smallest3.5 GB
GGUF
GE
Gemma 3 1B Roblox Luau
Gemma · TorpedoSoftware
Params1.3B
Context32K
Smallest0.9 GB
GGUF
GE
Gemma 4 12B Gemini 3.5 flash Reasoning Distill
Gemma · Ayodele01
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Rinna.Gemma 2 Baku 2b It
Gemma · DevQuasar-10
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
LaToucheCarre Texte S Gemma 3 1B Q5 K XL FR EN
Gemma · LaToucheCarre
Params881M
Context32K
Smallest0.7 GB
GGUF
GE
gemma 3 270m it phi lattice v2
Gemma · ununununununununununununununununununun
Params268M
Context32K
Smallest0.3 GB
GGUF
GE
ChaThai Gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma SEA LION v4 27B IT
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
GEMMA2 9b Pollux exp 2 i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
AP
Apollo2 2B
Apollo · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing