GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GW
Gwimi 4 12B IT
Gwimi · trjxter
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma 2 9B It SPPO Iter1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 1b It
Gemma · Open4bits
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gigantes v1 Gemma2 9b It
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Google Gemma 3 1b It
Gemma · tensorblock
Params1B
Context32K
Smallest0.7 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · WifiGhost
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · qwp4w3hyb
Params9.24B
Context8K
Smallest2.4 GB
GGUF
GE
Gemma 4 E2B It Assistant
Gemma · cafkafk
Params78M
Context128K
Q4_K_M0.1 GB
GGUF
EM
embeddinggemma 300m Q8A64
Embeddinggemma · VelociQ8
Params514M
Context2K
Smallest0.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · Felladrin
Params2.61B
Context8K
Smallest3.8 GB
GGUF
KO
Kokorogemma 1b It Fp16
Kokorogemma · mecatoncheir
Params1B
Context32K
Smallest1.1 GB
GGUF
GE
Gemma 2 27b It
Gemma · grapevine-AI
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · wsgmp3
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
TR
Translategemma 4b It
Translategemma · azmnc
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma-3-12B-It
Gemma · fwwrsd
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
byte v2 gemma 3 1b it v2
Gemma · 99Amit99
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 27b It
Gemma · dahara1
Params27.2B
Context8K
Q4_K_M18.0 GB
GGUF
GE
Gemma 3 12b It Abliterated Refined Novis
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
TA
Tanzania 0.3B
Tanzania · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
Roleplay
GE
Gemma 3 Fornax V4 27B QAT
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2b Aps It
Gemma · lmstudio-community
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 3 27b It Ultra Heretic
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
nidum/Nidum-Gemma-2B-Uncensored
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
DA
datagemma rag 27b it
Datagemma · second-state
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
MI
Mira v1.1 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma3 HADES 1B
Gemma · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
TY
Tyrant.002 1B
Tyrant · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
gemma 4 E4B vaccine xai merged qat
Gemma · hung2903
Params7.46B
Context128K
Smallest5.2 GB
ReasoningVision
GE
Gemma 3 4b It Qat Abliterated
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF

Keep browsing