GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
MI
MiLMMT 46 12B v0.1
Milmmt · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Vision
GE
EX Ai1 2.61B Gemma2
Gemma · EXAiStudio
Params2.61B
Context8K
Smallest1.7 GB
GGUF
GE
kofu gemma4 edge
Gemma · shebxyd
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
TE
Tema_Q X Thinking
Tema · mradermacher
Params14.8B
Context128K
Q4_K_M9.0 GB
ReasoningTool use
GE
ymcki gemma 2 2b jpn it abliterated 24
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
google gemma 3 12b it qat q4 0 gguf small
Gemma · stduhpf
Params11.8B
Context128K
Smallest6.9 GB
Vision
BO
Borealis Open 12b
Borealis · NbAiLab
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Mlabonne.Gemma 3 4b It Abliterated v2
Gemma · DevQuasar
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GA
GaMS 2B Instruct
Gams · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TE
test
Test · zuv0
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 3 1b It Qat Abliterated
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
MA
makandal multiple v2
Makandal · jsbeaudry
Params1B
Context32K
Q4_K_M0.8 GB
Tool use
GE
Gemma 3 1b It
Gemma · NikolayKozloff
Params1B
Context32K
Smallest1.1 GB
GGUF
GE
Gemma3 27b Cpt Gotoai v3 Instruct
Gemma · AsapGuide
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
slimorca-gemma2-9b-fft
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira v1.17 Karcher 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SO
Sorete 1B
Sorete · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Gemma 3 4b It Sanskrit Ocr
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · jaromer
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
2B
2B ad i1
mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 31B It Assistant
Gemma · ManniX-ITA
Params470M
Context256K
Q4_K_M0.4 GB
Vision
HE
Heretic.Anomaly 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 4B THINKING
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · q7741732
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · INSAIT-Institute
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
TU
s-emanuilov/Tucan-27B-v1.0
Tucan · llm-bg
Params27.2B
Context8K
Q4_K_M16.6 GB
Tool use
GE
Gemma 3n E2B
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
GE
Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced
Gemma · DK4AAD
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
SO
Sorete 1B
Sorete · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Gemma 3 4b It
Gemma · tatsuyaaaaaaa
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision

Keep browsing