GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
TE
Tema_Q R4.2
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FU
functiongemma 270m event commands
Functiongemma · rbrmafort
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
AT
Atlas Chat 9B
Atlas · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma2 Nephilim v3 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · Hjsfhdu
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
MI
Mira v1.5 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma SEA LION v3 9B IT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SH
Shieldgemma 9b
Shieldgemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MamayLM Gemma 3 4B IT v1.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Reasoning
GE
Rombo LLM V2.7 gemma 2 9b i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira v1.7 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Turkish Gemma 9b v0.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira V1.8.1A 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
AL
Alduin 4b It Base
Alduin · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Ndizi Gemma4 E2B African Asr Merged
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
gemma 3 12b instruct
Gemma · lm-kit
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 4b It Heretic Creative
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Meditron3 Gemma2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
diallm gemma grpo all
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 3n E4B It Absolute Heresy MPOA
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
GGUF
DA
datagemma rig 27b it
Datagemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Google Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
LL
Gemma 2 Llama Swallow 2b It v0.1
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Heretic_Fusion Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
BgGPT Gemma 2 27B IT v1.0
Gemma · INSAIT-Institute
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
NI
Nile Chat 12B
Nile · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Eunoia Gemma 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b Jpn It Abliterated 17 ORPO
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
AL
G2 9B Aletheia v1 i1
Aletheia · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing