GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 2b It
Gemma · phi0112358
Params2.61B
Context8K
Smallest2.8 GB
GGUF
EM
Embeddinggemma 300m
Embeddinggemma · dispatchAI
Params308M
Context2K
Smallest0.3 GB
Embedding
GE
Gemma 2 9b
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
GE
Gemma 3n E4B It
Gemma · ByteBasics101
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
gemma 7b openhermes v0.80
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
Tool use
GE
Gemma 3n E4B It
Gemma · velyan
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
Gemma 3 4b Pt
Gemma · thaitung
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 2 9b It
Gemma · brittlewis12
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · bkfjeijfsl
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
kuza gemma 4 e2b
Gemma · kuzaai
Params4.63B
Context128K
Q4_K_M2.6 GB
Reasoning
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · jstxn
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3n E2B it
Gemma · dengcao
Params4.46B
Context32K
Q4_K_M5.6 GB
Vision
GE
Gemma 4 31B JANG_4M CRACK F16
Gemma · ty12344321
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 2 2b It
Gemma · roshanai
Params2.61B
Context8K
Smallest2.2 GB
GGUF
GE
Gemma 3 12b It Dm 001
Gemma · Sketchfellow
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 1b It
Gemma · oncu
Params1B
Context32K
Smallest0.7 GB
GGUF
GE
Gemma 2 2b It
Gemma · brittlewis12
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 4b It
Gemma · AI-Engine
Params3.88B
Context128K
Smallest2.3 GB
GGUF
GE
gemma 3 27b it qat q4 0
Gemma · vinimuchulski
Params27B
Context128K
Smallest17.2 GB
Vision
SH
shieldgemma 2b
Shieldgemma · neopolita
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 9b
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
CO
Codegemma 7b
Codegemma · Aashraf995
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 4 12B coder fable5 composer2.5 v1 sft v3
Gemma · tpls
Params11.9B
Context256K
Q4_K_M8.6 GB
CodingTool use
GE
gemma 4 31B it qat Q4 0 V2
Gemma · wazimondo
Params30.7B
Context128K
Smallest0.3 GB
ReasoningTool useVision
GE
Gemma 2 9b It
Gemma · jaahas
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GE
ncd gemma4 e4b lora
Gemma · samwell
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
MA
Magnum v3 27b Kto
Magnum · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
gemma 3 1b Base
Gemma · 7ven7o
Params1B
Context32K
Smallest0.8 GB
GGUF

Keep browsing