Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 3 4b It Uncensored v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 4 26B A4B It Abliterix v6
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningRoleplayTool use
GE
ProtoSex RP Gemma2 2B
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
Roleplay
GE
Uncensored gemma 7b
Gemma · ICEPVP8977
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Models Mlabonne Gemma 3 1b It Abliterated
Gemma · MaziyarPanahi
Params1B
Context32K
Smallest0.8 GB
GGUF
GE
Gemma 3 27B IT
Gemma · brittlewis12
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 3 4b It Roleplay Tuned v2
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay
GE
Gemma 2b
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 E2B Heretic
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma4 Ubw Heretic Lora v12
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GE
Gemma 3 27b It Abliterated Normpreserve
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Aidc 5k Laos Gemma 3 4b It v2
Gemma · mradermacher
Params4.55B
Context128K
Q4_K_M2.9 GB
GGUF
GE
Gemma 4 12B It Esper4Tachibana
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
GE
openchat 3.5 0106 gemma
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 2 2b jpn it
Gemma · QuantFactory
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 3 27b it lecore
Gemma · staccs
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2B Uncensored
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 31B
Gemma · UnitGrief
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
Heretic
Gemma · scrybz
Params30.7B
Context256K
Smallest35.0 GB
CodingReasoningTool use
GE
gemma4 e4b mahou nsfw
Gemma · nuofang
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 3 4b It Heretic Logic
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma 2 2b It
Gemma · Kismi
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma 4 E4B it heretic
Gemma · kldzj
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
Gemma 4 31B It Claude Opus Distill
Gemma · Abiray
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool useVision
GE
amethyst 1 mini
Gemma · VertexAGI
Params4.55B
Context128K
Q4_K_M2.9 GB
Vision
GE
gemma-3n-E4B-it
Gemma · Mungert
Params6.87B
Context32K
Q4_K_M4.8 GB
Vision
GE
Gemma2 9b Cpt Sahabatai v1 Instruct
Gemma · gmonsoon
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
google gemma 4 E4B it tictactoe
Gemma · moe249
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
rsrishi10 gemma text2sql Instruct Finetune test
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF

Keep browsing