GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 2 9b instruct
Gemma · llmware
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27b It
Gemma · qwp4w3hyb
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
GGUF
KA
KavithaSaaram 9b it
Kavithasaaram · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 4 E2B uncensored slim
Gemma · NLLM-ai
Params4.65B
Context128K
Q4_K_M2.7 GB
ReasoningTool use
GE
Gemma-3-1B-It
Gemma · stratalab-org
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
EM
Embeddinggemma 300m
Embeddinggemma · second-state
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
GE
Google Gemma 3 4b It
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
Vision
GE
Gemma 2b Aps It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
EM
embeddinggemma 300m GGUF with dense modules
Embeddinggemma · cduk
Params308M
Context2K
Smallest0.2 GB
Embedding
BA
BanglaGPT Pro
Banglagpt · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GGUF
GE
Gemma 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
SA
Safeword Casual V1 12B
Safeword · ReadyArt
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
Gemma 3 12b It Biprojected Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
GenericRPV3 4B
Genericrpv · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision
GE
gemma 4 12B coder fable5 composer2.5 v1 abliterated
Gemma · tpls
Params11.9B
Context256K
Q4_K_M8.6 GB
CodingReasoningTool use
GE
Gemma4 E2B It Disinhibited
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma-3-12B-It
Gemma · socrate-tech
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
DA
Dark Pane
Dark · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
gemma 3 270m it
Gemma · QuantFactory
Params436M
Context32K
Q4_K_M0.4 GB
GGUF
WO
WoonaV1.2 9b
Woonav · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
KE
Keural Orbit v1.0
Keural · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
ReasoningTool useVision
AW
AWAXIS Think 31B
Awaxis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
ReasoningTool use
GO
Naphula Goetia 26B A4B v1.7 APEX
Goetia · npario
Params26B
Context256K
Q4_K_M17.4 GB
ReasoningRoleplayTool use
TO
Toolgrad 12b
Toolgrad · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
Tool useVision
GE
Gemma 3 4b It Abliterated Normpreserve
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3 12b It Abliterated
Gemma · matrixportalx
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
HU
humanizerth thai 12B
Humanizerth · chantra
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Google Gemma 3 12b It
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB
Vision

Keep browsing