GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 4 26B A4B It Abliterated
Gemma · SevenOfNine
Params25.2B
Context256K
Smallest19.1 GB
Vision
GE
Gemma 4 12B OBLITERATED
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GGUF
GE
Gemma4 26B A4B Uncensored HauhauCS 1M
Gemma · satgeze
Params25.2B
Context1024K
Q4_K_M16.8 GB
Vision
MA
magnum v3 9b chatml
Magnum · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 2b It
Gemma · lmstudio-community
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
SH
Shieldgemma 2b
Shieldgemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
TR
Translategemma 27b It
Translategemma · bullerwins
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 3 270m It
Gemma · bartowski
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
gemma-2-27b-it
Gemma · lmstudio-community
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
EM
Embeddinggemma 300M Qat Q4_0 Unquantized
Embeddinggemma · ggml-org
Params303M
Context2K
Smallest0.3 GB
Embedding
GE
Gemma 3 27b
Gemma · lmstudio-community
Params27B
Context128K
Smallest15.6 GB
Vision
GE
Gemmasutra Mini 2B v1
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemmuguinho 636m
Gemmuguinho · Papuguinho
Params636M
Context32K
Q4_K_M0.5 GB
GGUF
BO
Borealis Open 12b
Borealis · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 27b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params27B
Context128K
Smallest15.9 GB
Vision
GE
gemma 2 it
Gemma · unsloth
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 E2B Conversational Uncensored
Gemma · minas2025
Params4.65B
Context128K
Smallest5.0 GB
Vision
JA
JapanRailwayLLM
Japanrailwayllm · mradermacher
Params9.2B
Context8K
Q4_K_M5.8 GB
GGUF
MA
magnum v4 27b
Magnum · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 4b It Abliterated v2
Gemma · mlabonne
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
MA
magnum v4 27b
Magnum · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 2b It
Gemma · l3utterfly
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 12b It Qat
Gemma · bartowski
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
SARC Taigi LLM 12b
Gemma · Speech-AI-Research-Center
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 2 Ataraxy 9B
Gemma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-3-12B-It-Qat-Int4
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma 2 27b it abliterated
Gemma · QuantFactory
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 3 1b It Qat
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 3 4B it Uncensored
Gemma · lemuralabs
Params3.88B
Context128K
Smallest1.2 GB
GGUF
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params11.8B
Context128K
Smallest7.1 GB
Vision

Keep browsing