GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
magnum v3 9b chatml
Gemma · anthracite-org
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Google Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
MiLMMT 46 4B v0.1
Milmmt · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
ER
Erudite V2 1b
Erudite · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
LL
Gemma 2 9B Instruct
Llama · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Ada Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GA
GaMS3 12B
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma4 E2B It Disinhibited
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
gemma 2 2b jpn it abliterated 18 i1
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GO
google datagemma rag 27b it
Google · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
AM
Amethyst 1 Mini
Amethyst · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GE
EZO Gemma 2 2b Jpn It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
GemCod Codegen 270M
Gemcod · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
MI
MiLMMT 46 1B v0.1
Milmmt · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GE
Gemma 3 1b Pt
Gemma · ggml-org
Params1B
Context32K
Smallest2.0 GB
GE
Gemma 2 9b It
Gemma · dahara1
Params9.24B
Context8K
Q4_K_M6.8 GB
GE
google/gemma-2b-it
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GE
Gemma3 1B
Gemma · pjh64
Params1B
Context32K
Q4_K_M0.8 GB
MI
Mira v1.2 Dpo 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
Unsloth Gemma 3 1b It
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
GE
gemma2 9b cpt sea lionv3 instruct
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
BgGPT Gemma 2 9B IT v1.0
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
HE
Heretic.Erudite_v2 1B
Heretic · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 2 2b It
Gemma · tensorblock
Params2.61B
Context8K
Smallest1.2 GB
GE
MT5 Max Merge 02012025163610 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 E2B vaccine xai merged qat
Gemma · hung2903
Params4.63B
Context128K
Smallest3.3 GB
LL
Gemma 2 2B
Llama · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GE
Gemma 4 31B It Assistant
Gemma · cafkafk
Params470M
Context256K
Q4_K_M0.4 GB
GE
Gemma 3 4b Novision
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 4b It Heretic
Gemma · SimplySara
Params3.88B
Context128K
Q4_K_M2.5 GB