GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 9b Medical
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4b It Abliterated
Gemma · BernTheCreator
Params3.88B
Context128K
Smallest2.4 GB
Vision
TR
Translategemma 12b It
Translategemma · NikolayKozloff
Params11.8B
Context128K
Smallest9.7 GB
Vision
GE
Gemma 2 2b It
Gemma · Iambackup
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 4 26b a4b mobius custom c1
Gemma · moebiusT7
Params25.2B
Context256K
Smallest14.4 GB
ReasoningTool use
MI
Mira v1.14 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma4 Gutenberg 26B A4B
Gemma · spiritfather
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
gemma 2 9b
Gemma · lm-kit
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
joyai echo gemma3 12b encoder Q8 0
Gemma · joeygambino
Params12.2B
Context—
Smallest7.8 GB
GGUF
GE
Gemma 3 1b It Abliterated
Gemma · Otakadelic
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
bella bartender gemma 4 e2b
Gemma · juiceb0xc0de
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 2 2b Jpn It Mlx
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 3 1b it null space abliterated
Gemma · jwest33
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma2 9B KuwaNovelist
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2 9b
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 2b
Gemma · shahzeb171
Params2.51B
Context8K
Smallest1.2 GB
GGUF
GE
gemma 3 270m uk verbalizer
Gemma · skypro1111
Params125M
Context32K
Smallest0.3 GB
GGUF
GE
tanliboy lambda gemma 2 9b dpo
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
SH
Shieldgemma 2b
Shieldgemma · LiteLLMs
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BO
Borealis 270m Instruct Preview
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
Vertex Gemma 2b Mcp
Gemma · Denisijcu
Params2.61B
Context8K
Q4_K_M1.7 GB
CodingTool use
DA
Dark Goetia 26B A4B v2
Dark · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningRoleplayTool use
KO
KONI 4B Instruct 20250901
Koni · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
MI
Mira v1.5 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
MI
ilo toki 1.4 MiLMMT 46 1b merged
Milmmt · NetherQuartz
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Dolphin 2.9.4 Gemma2 2b
Gemma · itlwas
Params2.61B
Context8K
Q4_K_M1.7 GB
Coding
GE
MT3 Gen10 gemma 2 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KA
kairsun 270m
Kairsun · KairSun
Params268M
Context32K
Smallest0.0 GB
GGUF
HE
Hereticsutra 2B
Hereticsutra · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
GemmaX2 28 9B Pretrain
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing