GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 27b
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 27b Chatml
Gemma · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
KA
KatipGPT Base
Katipgpt · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DH
Dhruv 27B
Dhruv · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
VI
T Virus 1B
Virus · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
SA
sappha 2b v3 i1
Sappha · mradermacher
Params2.51B
Context8K
Q4_K_M1.6 GB
GGUF
GE
Gemma 4 E2B It
Gemma · DuoNeural
Params4.65B
Context128K
Q4_K_M2.7 GB
GGUF
GE
DARUSHKA2161/gemma-2-2b-it-lockal
Gemma · featherless-ai-quants
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma4-12B-QAT-Uncensored-HauhauCS-Balanced
Gemma · akpsahan
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningRoleplayTool use
GE
ymcki gemma 2 2b jpn it abliterated 18
Gemma · RichardErkhov
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 3 4b It
Gemma · itlwas
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
gemma 4 12b mobius custom c1
Gemma · moebiusT7
Params11.9B
Context256K
Smallest7.0 GB
ReasoningTool use
GE
INSAIT Institute_MamayLM Gemma 3 12B IT v1.0
Gemma · INSAIT-Institute
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 3 1b It
Gemma · s3dev-ai
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
nehme flashcheck 1b
Gemma · nehmeailabs-org
Params1B
Context32K
Smallest1.1 GB
GGUF
GE
gemma-2-9b-it
Gemma · AI-Engine
Params9.24B
Context8K
Smallest3.8 GB
GGUF
FU
smartpanel functiongemma 270m
Functiongemma · BrinqAI
Params268M
Context32K
Q4_K_M0.3 GB
EmbeddingTool use
GE
Meditron3 Gemma2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 Fornax V3 12B QAT CoT
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
SI
SILMA Kashif 2B Instruct v1.0
Silma · NoahAdamson
Params2.61B
Context12K
Q4_K_M1.7 GB
GGUF
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · marafx2007
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool useVision
GE
Hacker News Comments Summarization Gemma 3 27b It
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
Gemma 2 2b
Gemma · RichardErkhov
Params1.95B
Context8K
Q4_K_M1.7 GB
GGUF
GE
gemma-2-27b-it
Gemma · gaianet
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 2B MedicalQA Assistant
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Floppa 12B Gemma3 Uncensored
Gemma · Ryex
Params11.8B
Context128K
Smallest8.4 GB
Vision
GE
MT Merge3 gemma 2 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4b It Abliterated v2
Gemma · EsteefAi
Params3.88B
Context128K
Smallest3.2 GB
GGUF
GO
Dark-Goetia-26B-A4B-LoRA-v2-с177
Goetia · SubMaroon
Params23M
Context—
Smallest0.0 GB
GGUF
GE
Toutetsu Gemma 3 1b Roleplay 32K
Gemma · Green-Eye
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay

Keep browsing