GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 1b It Abliterated
Gemma · mlabonne
Params1B
Context32K
Q4_K_M0.8 GB
Vision
AT
Atom v1 Preview 12b
Atom · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Reasoning
GE
Gemma 4 26B A4B It Abliterix v6
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma 3 4b It
Gemma · gaianet
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
AT
Atlas Chat 2B
Atlas · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 4b It Claude
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Floppa 12B Gemma3 Uncensored
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Abliterated
Gemma · anlord
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 3 4b Pt
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma-2-27b-it
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma4 31B Uncensored HauhauCS 1M
Gemma · satgeze
Params30.7B
Context128K
Smallest0.3 GB
ReasoningTool useVision
GE
Gemma3 27b It Abliterated Normpreserve v1
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma-2-27B-Chinese-Chat
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
AL
G2 9B Aletheia v1
Aletheia · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
LL
Gemma 2 Llama Swallow 9b it v0.1 Heretic
Llama · ChiKoi7
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma-3-1B-It
Gemma · ThyBoof
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · Mal1cc
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Huihui Gemma 3 270m It Abliterated
Gemma · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Atlas Chat 9B
Gemma · QuantFactory
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma-2-9b-it
Gemma · qwp4w3hyb
Params9.24B
Context8K
Smallest2.4 GB
GGUF
GE
gemma 2 2b LoRA MonsterInstruct
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mira v1.12.1 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Coding
GE
GemmaX2 28 9B v0.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b It Norm Preserved Biprojected Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 27b It Heretic
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
CodingVision
TR
Translategemma 4b It
Translategemma · tatsuyaaaaaaa
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GA
GaMS3 12B Instruct
Gams · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
SU
G2 9B Sugarquill v0
Sugarquill · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · ScottzillaSystems
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision

Keep browsing