GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Gemma 4 E4B It
Gemma · san27079
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 Gaia PT BR 4b It
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
JapanRailwaysimLLM
Gemma · galakenya
Params—
Context—
Smallest0.0 GB
GE
Amoral Gemma3 12B Vision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
MI
Mira 1.10 Dpo 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 4 12B coder fable5 composer2.5
Gemma · sakamakismile
Params11.9B
Context128K
Q4_K_M7.4 GB
BO
Borealis Open 27b
Borealis · NbAiLab
Params27B
Context128K
Q4_K_M16.5 GB
SI
SimplyAI 2B Uncensored i1
Simplyai · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
ER
EraX Translator V1.0
Erax · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
LL
Gemma 2 9B
Llama · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma-1.1-2b-it
Gemma · second-state
Params2.51B
Context8K
Q4_K_M1.6 GB
MI
Mira v1.24.2 27B Karcher
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2 27b It Abliterated
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
LU
Luna 27B v0
Luna · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 3 4b It Abliterated v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
MI
Mira v1.19.2 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
SP
Spoomplesmaxx Whiskeyjack 12B
Spoomplesmaxx · mradermacher
Params12.9B
Context256K
Q4_K_M7.9 GB
GE
google gemma 3 27b it qat q4 0 gguf small
Gemma · stduhpf
Params27B
Context128K
Smallest15.6 GB
CL
Clemma E4B
Clemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
GE
Gemma 3 12b It Ultra Heretic
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
FU
functiongemma-270m-it
Functiongemma · Mungert
Params268M
Context32K
Q4_K_M0.3 GB
GE
Saiga_Gemma3_12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Google Gemma 3 27b It Text
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
gemma 7b openhermes v0.80 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
MI
Mira v1.16 Ties 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
google gemma 3 1b it qat q4 0 gguf small
Gemma · stduhpf
Params1B
Context32K
Smallest0.7 GB
SM
Smilodon 9B v0.5
Smilodon · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
KA
Kanimus 26B A4B FFT Heretic
Kanimus · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GE
google_gemma-3-12b-it
Gemma · Mungert
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
ganda gemma 1b
Gemma · CraneAILabs
Params1B
Context32K
Q4_K_M0.8 GB