GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Ganesh Java v0.1.0
Gemma · Executespec
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
Gemma 2 9b It
Gemma · GPT4All-Community
Params9.24B
Context8K
Smallest5.4 GB
GGUF
AP
Apollo2 2B
Apollo · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
ME
medgemma 1.5 4b it
Medgemma · mackkkkkilllll
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma-2-9b-it
Gemma · BenevolenceMessiah
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
Gemma 3 1b It
Gemma · Abdoul-AI
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
zoomerlm gemma4 e2b
Gemma · 3ndetz
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
Gemma-4-26B-A4B-it-Heretic
Gemma · Sapfir900
Params25.2B
Context256K
Smallest11.7 GB
CodingReasoningTool use
TO
Novaciano Toxic.NPC 1B
Toxic · Flexan
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
Gemma 4 31B it RAM 43GB
Gemma · baa-ai
Params30.7B
Context256K
Smallest42.9 GB
ReasoningTool use
GE
dolphin 2.9.4 gemma2 2b
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 9B It SPPO Iter2
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GA
GaMS 9B SFT Translator
Gams · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Sedna 26B TR
Gemma · afkfatih
Params25.2B
Context256K
Smallest14.4 GB
ReasoningTool useVision
GE
Gemma 2 9b Medical
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
MiLMMT 46 4B v0.1
Milmmt · OrpheraAI
Params4B
Context128K
Q4_K_M2.9 GB
GGUF
GE
gemma 4 12b it abliterated
Gemma · smashingtags
Params11.9B
Context256K
Smallest7.0 GB
ReasoningTool useVision
MI
Mira V1.8.1A 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Samanta NewGenesis Gemma2B DPO
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
GemmOwO 2B
Gemmowo · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
WI
Wiroai Turkish Llm 9b
Wiroai · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SB
UW SBEL ChronoGemma 27b it
Sbel · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 2b
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma-2b-it
Gemma · narainp
Params2.51B
Context8K
Smallest3.1 GB
GGUF
GE
MT3 Gen11 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
VI
Virgil 9B
Virgil · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
VirgiF continue pretrain gemma more pause
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
pii guard turkish 270m
Gemma · cagrigungor
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Gemma4 12B IT Abliterated
Gemma · Riyan200324200324
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma4 E4B TIES 3mask R64
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use

Keep browsing