GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
TE
Tema_Q R4.2
Tema · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
FU
functiongemma 270m event commands
Functiongemma · rbrmafort
Params268M
Context32K
Q4_K_M0.3 GB
AT
Atlas Chat 9B
Atlas · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma2 Nephilim v3 9B
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · Hjsfhdu
Params11.9B
Context128K
Q4_K_M7.4 GB
MI
Mira v1.5 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma SEA LION v3 9B IT
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
SH
Shieldgemma 9b
Shieldgemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MamayLM Gemma 3 4B IT v1.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Rombo LLM V2.7 gemma 2 9b i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Mira v1.7 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Turkish Gemma 9b v0.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Mira V1.8.1A 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
AL
Alduin 4b It Base
Alduin · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma3 4b It Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Ndizi Gemma4 E2B African Asr Merged
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
gemma 3 12b instruct
Gemma · lm-kit
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 4b It Heretic Creative
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Meditron3 Gemma2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
diallm gemma grpo all
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3n E4B It Absolute Heresy MPOA
Gemma · mradermacher
Params6.87B
Context32K
Q4_K_M4.2 GB
DA
datagemma rig 27b it
Datagemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Google Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
LL
Gemma 2 Llama Swallow 2b It v0.1
Llama · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Heretic_Fusion Gemma3 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
BgGPT Gemma 2 27B IT v1.0
Gemma · INSAIT-Institute
Params27.2B
Context8K
Q4_K_M16.6 GB
NI
Nile Chat 12B
Nile · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Eunoia Gemma 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 2 2b Jpn It Abliterated 17 ORPO
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
AL
G2 9B Aletheia v1 i1
Aletheia · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB