GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
Sakura Gemma4 E2B EmbeddingGemma2 DualMode
Gemma · webmp3
Params4.65B
Context128K
Smallest3.6 GB
Embedding
AA
aac board generator 770m ptbr
Aac · tardellirs
Params772M
Context32K
Q4_K_M0.6 GB
GGUF
CO
codegemma-7b-it
Codegemma · bartowski
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
KI
Kitchoon V2 26B A4B
Kitchoon · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplayTool use
TE
Tema_Q R2.0 Code
Tema · mradermacher
Params8.5B
Context8K
Q4_K_M5.3 GB
Coding
GE
gemma3
Gemma · libretranslate
Params11.8B
Context32K
Smallest1.0 GB
GGUF
GE
Gemma 4 12B HybridAgent
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
ReasoningTool use
CO
codegemma-1.1-2b
Codegemma · mmnga
Params2.51B
Context8K
Q4_K_M1.6 GB
Coding
GE
gemma 3n E2B it
Gemma · ggml-org
Params4.46B
Context32K
Smallest4.8 GB
GGUF
GE
Gemma4 Gutenberg Literotica 12B
Gemma · mradermacher
Params11.9B
Context256K
Q4_K_M7.4 GB
GGUF
GE
Gemma 2 27b It
Gemma · ThomasBaruzier
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 Ataraxy 9B i1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma4 comfyui mcp
Gemma · artokun
Params11.9B
Context128K
Q4_K_M3.4 GB
CodingTool use
SI
SILMA 9B Instruct v1.0
Silma · bartowski
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 4 A4B 98e v6 Coder It
Gemma · ManniX-ITA
Params19.9B
Context256K
Q4_K_M10.6 GB
CodingVision
GE
Instinct Python Coder Gemma4 12B Qwen3.8 27B
Gemma · projectj
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
GE
Gemma 2 2B ArliAI RPMax v1.1
Gemma · bartowski
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
GE
Gemma 4 E2B It Abliterated
Gemma · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GGUF
GE
Gemma-2-9B-It-SPPO-Iter3
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma 3n E4B it
Gemma · ggml-org
Params6.9B
Context32K
Smallest7.4 GB
GGUF
JA
JapanRailwaysimLLM
Japanrailwaysimllm · mradermacher
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma-4-E4B-Uncensored-HauhauCS-Aggressive
Gemma · Amory0201
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
Gemma4 E4B Mahou Nsfw
Gemma · mradermacher
Params7.46B
Context128K
Q4_K_M5.3 GB
ReasoningRoleplayTool use
BO
Borealis Open 270m
Borealis · mradermacher
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
BO
Boulesis v2 26B A4B
Boulesis · mradermacher
Params26B
Context256K
Q4_K_M17.2 GB
ReasoningRoleplay
ER
Erebus RP 12B Instruct 2608 v1
Erebus · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Roleplay
GE
gemma 4 E4B it qat q4 0 heretic
Gemma · FadedRedStar
Params7.46B
Context128K
Smallest0.1 GB
CodingVision
DA
datagemma rig 27b it
Datagemma · bartowski
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 2b
Gemma · legraphista
Params2.61B
Context8K
Smallest0.8 GB
GGUF
GE
gemma 3 4b instruct
Gemma · lm-kit
Params3.88B
Context128K
Q4_K_M2.5 GB
GGUF

Keep browsing