GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
MI
MiLMMT 46 12B v0.1
Milmmt · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
EX Ai1 2.61B Gemma2
Gemma · EXAiStudio
Params2.61B
Context8K
Smallest1.7 GB
GE
kofu gemma4 edge
Gemma · shebxyd
Params7.46B
Context128K
Q4_K_M5.3 GB
TE
Tema_Q X Thinking
Tema · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
GE
ymcki gemma 2 2b jpn it abliterated 24
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
google gemma 3 12b it qat q4 0 gguf small
Gemma · stduhpf
Params11.8B
Context128K
Smallest6.9 GB
BO
Borealis Open 12b
Borealis · NbAiLab
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Mlabonne.Gemma 3 4b It Abliterated v2
Gemma · DevQuasar
Params3.88B
Context128K
Q4_K_M2.5 GB
GA
GaMS 2B Instruct
Gams · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
TE
test
Test · zuv0
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Gemma 3 1b It Qat Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
MA
makandal multiple v2
Makandal · jsbeaudry
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 1b It
Gemma · NikolayKozloff
Params1B
Context32K
Smallest1.1 GB
GE
Gemma3 27b Cpt Gotoai v3 Instruct
Gemma · AsapGuide
Params27B
Context128K
Q4_K_M16.5 GB
GE
slimorca-gemma2-9b-fft
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Mira v1.17 Karcher 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SO
Sorete 1B
Sorete · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4b It Sanskrit Ocr
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · jaromer
Params30.7B
Context256K
Q4_K_M18.7 GB
2B
2B ad i1
mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 31B It Assistant
Gemma · ManniX-ITA
Params470M
Context256K
Q4_K_M0.4 GB
HE
Heretic.Anomaly 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4B THINKING
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · q7741732
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · INSAIT-Institute
Params2.61B
Context8K
Q4_K_M1.7 GB
TU
s-emanuilov/Tucan-27B-v1.0
Tucan · llm-bg
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 3n E2B
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GE
Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced
Gemma · DK4AAD
Params11.9B
Context256K
Q4_K_M7.4 GB
SO
Sorete 1B
Sorete · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 3 4b It
Gemma · tatsuyaaaaaaa
Params3.88B
Context128K
Q4_K_M2.5 GB