GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
KA
Karakuri Lm 7b Apm v0.1
Karakuri · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
EZO Common T2 2B Gemma 2 It
Gemma · MCZK
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
DE
Delirium v1 Abliterated
Delirium · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TU
LLMBG ToolUse 2.6B v1.0
Tucan · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Tool use
GE
Gemma 3 4b It Abliterated Normpreserve
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
MA
magnum v3 9b chatml i1
Magnum · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4b It Qat Abliterated
Gemma · mlabonne
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
typhoon2.1 gemma3 12b
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningTool use
GE
Gemma4-31B-QAT-Uncensored-HauhauCS-Balanced
Gemma · Vestmanna
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Orthogonal Reflection Bounded Ablation v4 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 1b It
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
NI
Nile Chat 12B
Nile · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
child gemma4 e2b v5
Gemma · mie-edu
Params4.63B
Context128K
Smallest3.8 GB
Reasoning
GE
Gemma4 31b Gembrain Equinox
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
EZO Gemma 2 2b Jpn It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 JP EN Translator v1 4B
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
MI
Mira v1.2 Dpo 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Coding
OC
Ocd Therapist 27b v0.3
Ocd · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 4b It Ko Reasoning
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
ReasoningVision
GE
BgGPT Gemma 2 2.6B IT v1.0
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma4-26B-A4B-QAT-Uncensored-HauhauCS-Balanced
Gemma · jaromer
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
MI
Mimma 3 27b
Mimma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
SU
Super Slop Machina XXL v0.1 4B
Super · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
Gemma3 12B CIC SciCite
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
DreamFast Gemma 3 12b It Heretic v2
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
CodingVision
CO
Codegemma 7b It
Codegemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 2 Ifable 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SU
Sungur 9B
Sungur · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
TY
PE Type 3 Nova 4B
Type · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision

Keep browsing