GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Gemma 2 27b Chatml
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Google.Gemma 3 12b It Qat Int4 Unquantized
Gemma · DevQuasar-12
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
UR
Uroboros 2B
Uroboros · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 2 27b It
Gemma · RichardErkhov
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GW
GWQ 9B Preview
Gwq · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
FU
functiongemma 270m physical ai
Functiongemma · BrinqAI
Params268M
Context32K
Q4_K_M0.3 GB
Tool use
AL
Alexia.FinalEvolution 1B
Alexia · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
Gemma 2 9b Chatml
Gemma · RichardErkhov
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira v1.21 27B Rlvr
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GGUF
CO
codegemma-7b-it
Codegemma · second-state
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma4 12b spotlight orchestrator v5
Gemma · tomvaillant
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
EM
Embeddinggemma 300m
Embeddinggemma · gaianet
Params303M
Context2K
Q4_K_M0.2 GB
Embedding
GE
Gemma SEA LION v3 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 4B T1 It
Gemma · twinkle-ai
Params4.55B
Context128K
Q4_K_M2.9 GB
ReasoningTool use
SA
Safeword Casual V1 R1 12B
Safeword · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
ReasoningRoleplay
GE
Aidc Llm Laos 10k Gemma 3 12b It
Gemma · mradermacher
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma 3 12b It Abliterated
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
CO
Codegemma 1.1 7b It
Codegemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 3 4b est v1
Gemma · Abdusin
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF
GE
Gemma4_E2B_Abliterated_Baked_HF_Ready
Gemma · mradermacher
Params4.63B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 2 Ataraxy 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 27B Roblox Luau
Gemma · TorpedoSoftware
Params28.4B
Context128K
Q4_K_M17.3 GB
GGUF
LA
lapa v0.1.2 instruct
Lapa · lapa-llm
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma 7b Aps It
Gemma · RichardErkhov
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma-4-E2B-Uncensored-HauhauCS-Aggressive
Gemma · braydenh563
Params4.65B
Context128K
Q4_K_M3.5 GB
ReasoningTool use
GE
Gemma 2 2b It
Gemma · medmekk
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
MI
Mira V1.8.1B 27B
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
CodingVision
GE
Kitsunebi v1 Gemma2 8k 9B
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3 12b Pt
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
DA
DarkIdol Aria 4B
Darkidol · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Roleplay

Keep browsing