GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Huihui Gemma 3n E4B It Abliterated
Gemma · matrixportalx
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
GE
gemma 4 qat mtp assistant heads
Gemma · boxwrench
Params423M
Context128K
Smallest0.5 GB
ReasoningTool use
GE
Gemma 2 2b It
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
CodingReasoning
GE
Occitan Gemma 3 4b It Lora Merged
Gemma · julienp79
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
MT1 Gen11 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PO
PolDense-150M
Poldense · kprzyb
Params149M
Context8K
Smallest0.2 GB
Embedding
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · anonoob
Params11.9B
Context128K
Q4_K_M7.4 GB
CodingReasoningTool use
GE
gemma 3 1b it qat q4 0
Gemma · tetf
Params1B
Context32K
Smallest1.0 GB
GGUF
GE
gemma 3 27b it abliterated normpreserve v1
Gemma · YanLabs
Params27B
Context128K
Smallest28.7 GB
GGUF
GE
Gemma 3 4b It
Gemma · Martin7374
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
PolyAgent gemma 7b ua ckpt h100 lower lr
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
FE
Fermata v1.2 Light
Fermata · mradermacher
Params596M
Context40K
Q4_K_M0.4 GB
ReasoningTool use
NI
MBZUAI Paris Nile Chat 4B
Nile · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
GGUF
GE
gemma 4 E4B wallet ft v5
Gemma · ef-ai
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
dhivehi gemma 3 4b
Gemma · Sajiiid
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
PO
PolDense-400M
Poldense · kprzyb
Params395M
Context8K
Smallest0.4 GB
Embedding
GE
gemma2 9b id guidelines
Gemma · Drfrodik
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma3 9b It Girl v3
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
DE
DeepSeek GRM 27B
DeepSeek · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
Tool use
GE
AliMaatouk/Gemma-2B-Tele
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · tudoriviera
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Gemma 3 4b It
Gemma · Martin7374
Params3.88B
Context128K
Smallest1.7 GB
Vision
GE
Gifted Maths Gemma 4 legacy
Gemma · arabellako22
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool useVision
GE
lemon-mint/gemma-2b-translation-v0.102
Gemma · featherless-ai-quants
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
gemma 4 E2B it phishing
Gemma · vete-speis
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 26B A4B VisualNovel
Gemma · build-small-hackathon
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
AM
Amoral.Extreme 1B
Amoral · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
GE
gemma 4 12B netsec expert
Gemma · mhndayesh
Params11.9B
Context256K
Smallest7.0 GB
ReasoningTool use
GE
gemma-2-9b-it-abliterated
Gemma · KnutJaegersberg
Params9.24B
Context8K
Smallest9.8 GB
GGUF
KO
KoGemma-E2B
Kogemma · waylake
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use

Keep browsing