GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
gemma-2-9b-it
Gemma · quixotedav
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
YA
YanoljaNEXT Rosetta 27B 2511
Yanoljanext · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
GE
Gemma3NPC 1b Float16
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 4b It
Gemma · recursechat
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma 1.1 7b it
Gemma · alokabhishek
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 12B It
Gemma · DuoNeural
Params11.9B
Context256K
Q4_K_M7.1 GB
ReasoningTool use
GE
Gemma 4 A4B 98e v6 Coder It
Gemma · fribourgquant
Params19.9B
Context256K
Q4_K_M10.6 GB
CodingReasoningTool use
DA
datagemma rig 27b it
Datagemma · DevQuasar-4
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
IlyaGusev saiga gemma2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3 4b african medical ocr
Gemma · Javo3000
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma2 9b Cpt Sahabatai v1 Base
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma Kimu 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Occitan Gemma 3 4b It Dora
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
BO
Borealis 27b Instruct Preview
Borealis · NbAiLab
Params28.4B
Context128K
Q4_K_M17.3 GB
Vision
GE
Gemma 4 12B agentic abliterated
Gemma · PocketWeights
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
grimjim Magnolia v1 Gemma2 8k 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · yemmygold
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemmabloom
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 12b it uncensored th
Gemma · lucifer053
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 2 2b It
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
vicky4s4s/gemma-2-2b-instruct
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
YA
YanoljaNEXT Rosetta 4B 2511
Yanoljanext · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3 40b
Gemma · mradermacher
Params39.8B
Context128K
Q4_K_M24.3 GB
GGUF
WI
Wiroai Turkish Llm 9b
Wiroai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Ytu Ce cosmos.Turkish Gemma 9b v0.1
Gemma · DevQuasar
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
HU
Hunter.Beta 1B
Hunter · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SA
Safeword Casual v1 R1 4B
Safeword · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningRoleplayVision
FU
Functiongemma 270m It Abominable Heresy
Functiongemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
AT
Atlas Chat 9B
Atlas · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
HE
Hereticsutra.Mini 2B UltraRP
Hereticsutra · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF

Keep browsing