GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
gemma-2-9b-it
Gemma · quixotedav
Params9.24B
Context8K
Q4_K_M5.8 GB
YA
YanoljaNEXT Rosetta 27B 2511
Yanoljanext · mradermacher
Params28.4B
Context128K
Q4_K_M17.3 GB
GE
Gemma3NPC 1b Float16
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4b It
Gemma · recursechat
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 1.1 7b it
Gemma · alokabhishek
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 4 12B It
Gemma · DuoNeural
Params11.9B
Context256K
Q4_K_M7.1 GB
GE
Gemma 4 A4B 98e v6 Coder It
Gemma · fribourgquant
Params19.9B
Context256K
Q4_K_M10.6 GB
DA
datagemma rig 27b it
Datagemma · DevQuasar-4
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
IlyaGusev saiga gemma2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 3 4b african medical ocr
Gemma · Javo3000
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma2 9b Cpt Sahabatai v1 Base
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma Kimu 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Occitan Gemma 3 4b It Dora
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
BO
Borealis 27b Instruct Preview
Borealis · NbAiLab
Params28.4B
Context128K
Q4_K_M17.3 GB
GE
Gemma 4 12B agentic abliterated
Gemma · PocketWeights
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
grimjim Magnolia v1 Gemma2 8k 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · yemmygold
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemmabloom
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 12b it uncensored th
Gemma · lucifer053
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Gemma 2 2b It
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
vicky4s4s/gemma-2-2b-instruct
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
YA
YanoljaNEXT Rosetta 4B 2511
Yanoljanext · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 40b
Gemma · mradermacher
Params39.8B
Context128K
Q4_K_M24.3 GB
WI
Wiroai Turkish Llm 9b
Wiroai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Ytu Ce cosmos.Turkish Gemma 9b v0.1
Gemma · DevQuasar
Params9.24B
Context8K
Q4_K_M5.8 GB
HU
Hunter.Beta 1B
Hunter · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
SA
Safeword Casual v1 R1 4B
Safeword · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
FU
Functiongemma 270m It Abominable Heresy
Functiongemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
AT
Atlas Chat 9B
Atlas · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
HE
Hereticsutra.Mini 2B UltraRP
Hereticsutra · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB