GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
GE
Gemma 2 9B ArliAI RPMax v1.1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 2 9b instruct
Gemma · llmware
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3 27b It
Gemma · qwp4w3hyb
Params27B
Context128K
Q4_K_M16.5 GB
GE
Gemma 2 9b It
Gemma · tensorblock
Params9.24B
Context8K
Smallest3.8 GB
KA
KavithaSaaram 9b it
Kavithasaaram · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma 4 E2B uncensored slim
Gemma · NLLM-ai
Params4.65B
Context128K
Q4_K_M2.7 GB
GE
Gemma-3-1B-It
Gemma · stratalab-org
Params1B
Context32K
Q4_K_M0.8 GB
EM
Embeddinggemma 300m
Embeddinggemma · second-state
Params303M
Context2K
Q4_K_M0.2 GB
GE
Google Gemma 3 4b It
Gemma · tensorblock
Params3.88B
Context128K
Smallest1.7 GB
GE
Gemma 2b Aps It
Gemma · RichardErkhov
Params2.51B
Context8K
Q4_K_M1.6 GB
EM
embeddinggemma 300m GGUF with dense modules
Embeddinggemma · cduk
Params308M
Context2K
Smallest0.2 GB
BA
BanglaGPT Pro
Banglagpt · mradermacher
Params1.3B
Context32K
Q4_K_M1.0 GB
GE
Gemma 2b It
Gemma · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
SA
Safeword Casual V1 12B
Safeword · ReadyArt
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 12b It Biprojected Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
GenericRPV3 4B
Genericrpv · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
gemma 4 12B coder fable5 composer2.5 v1 abliterated
Gemma · tpls
Params11.9B
Context256K
Q4_K_M8.6 GB
GE
Gemma4 E2B It Disinhibited
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
GE
Gemma-3-12B-It
Gemma · socrate-tech
Params11.8B
Context128K
Q4_K_M7.3 GB
DA
Dark Pane
Dark · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
gemma 3 270m it
Gemma · QuantFactory
Params436M
Context32K
Q4_K_M0.4 GB
WO
WoonaV1.2 9b
Woonav · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
KE
Keural Orbit v1.0
Keural · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
AW
AWAXIS Think 31B
Awaxis · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GO
Naphula Goetia 26B A4B v1.7 APEX
Goetia · npario
Params26B
Context256K
Q4_K_M17.4 GB
TO
Toolgrad 12b
Toolgrad · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GE
Gemma 3 4b It Abliterated Normpreserve
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3 12b It Abliterated
Gemma · matrixportalx
Params11.8B
Context128K
Q4_K_M7.3 GB
HU
humanizerth thai 12B
Humanizerth · chantra
Params11.9B
Context256K
Q4_K_M7.4 GB
GE
Google Gemma 3 12b It
Gemma · tensorblock
Params11.8B
Context128K
Smallest4.8 GB