GGUF models: gemma license

5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
AF
African ultrachat alpaca i1
African · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
gemma 3 270m instruct
Gemma · lm-kit
Params268M
Context32K
Q4_K_M0.3 GB
GGUF
GE
gemma-2-9b-it
Gemma · zhezhe
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Mira V1.22.2B 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
Vision
GE
EX Ai1 3.88B Gemma3
Gemma · EXAiStudio
Params3.88B
Context128K
Smallest2.5 GB
GGUF
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · minte1431
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool useVision
GE
Text To Cypher Gemma 3 4B Instruct 2025.04.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma 3n E2B It Absolute Heresy MPOA
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GGUF
GE
Gemma 3 27b It FT Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
ReasoningVision
HA
Hans_Wesker 1B
Hans · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
Roleplay
BL
Blaze.1 27B Reflection i1
Blaze · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
Gemma 2 9B It SPPO Iter1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
gemma ko 7b instruct v0.71 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GGUF
GE
Gemma 4 E2B It
Gemma · san27079
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningTool use
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v1 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
BO
bonsai 2b
Bonsai · mradermacher
Params2.61B
Context128K
Q4_K_M1.7 GB
GGUF
GE
lyrics room topline gemma4 12b v9
Gemma · rambrogi
Params11.9B
Context256K
Smallest9.8 GB
ReasoningTool use
GE
Gemma 2 2B Stheno Filtered
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
GGUF
BA
BartaLens E2B
Bartalens · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
ReasoningVision
GE
Amoral Gemma3 12B Vision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma 3 4b It
Gemma · gsxrchris
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Gemma3 9b It Girl v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
Gemma3 1B Tools
Gemma · iromu
Params1B
Context32K
Q4_K_M0.8 GB
Tool use
GE
Gemma 4 21b A4B It REAP
Gemma · Ayodele01
Params20.8B
Context256K
Q4_K_M13.8 GB
ReasoningTool use
GE
PopiT Gemma 3 12B Medical SFT 1218
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
Gemma2 9b WangchanLIONv2 instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma 3n E4B It Absolute Heresy
Gemma · MuXodious
Params6.87B
Context32K
Q4_K_M4.2 GB
Vision
CR
Crow 9B It
Crow · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
DI
diffusiongemma 26B A4B it
Diffusiongemma · AlexAtomic
Params25.3B
Context256K
Q4_K_M16.8 GB
ReasoningTool use
GE
Gemma 3 4b It Roleplay Tuned v1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
RoleplayVision

Keep browsing