GGUF models: gemma license
5164 GGUF models listed under the gemma license on Hugging Face. Always read the license text before commercial use. Sizes run from 3M to 177B parameters. The longest trained context is 1024K tokens.
AF
African ultrachat alpaca i1
African · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
gemma 3 270m instruct
Gemma · lm-kit
Params268M
Context32K
Q4_K_M0.3 GB
GE
gemma-2-9b-it
Gemma · zhezhe
Params9.24B
Context8K
Q4_K_M5.8 GB
MI
Mira V1.22.2B 27B Dpo
Mira · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
GE
EX Ai1 3.88B Gemma3
Gemma · EXAiStudio
Params3.88B
Context128K
Smallest2.5 GB
GE
Gemma-4-12B-OBLITERATED-v2
Gemma · minte1431
Params11.9B
Context128K
Q4_K_M7.4 GB
GE
Text To Cypher Gemma 3 4B Instruct 2025.04.0
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma 3n E2B It Absolute Heresy MPOA
Gemma · mradermacher
Params4.46B
Context32K
Q4_K_M2.8 GB
GE
Gemma 3 27b It FT Reasoning
Gemma · mradermacher
Params27B
Context128K
Q4_K_M16.5 GB
HA
Hans_Wesker 1B
Hans · mradermacher
Params1B
Context32K
Q4_K_M0.8 GB
BL
Blaze.1 27B Reflection i1
Blaze · mradermacher
Params27.2B
Context8K
Q4_K_M16.6 GB
GE
Gemma 2 9B It SPPO Iter1
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
gemma ko 7b instruct v0.71 i1
Gemma · mradermacher
Params8.54B
Context8K
Q4_K_M5.3 GB
GE
Gemma 4 E2B It
Gemma · san27079
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Gemma 3 12b It Orthogonal Rotation Bounded Ablation v1 12B
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
BO
bonsai 2b
Bonsai · mradermacher
Params2.61B
Context128K
Q4_K_M1.7 GB
GE
lyrics room topline gemma4 12b v9
Gemma · rambrogi
Params11.9B
Context256K
Smallest9.8 GB
GE
Gemma 2 2B Stheno Filtered
Gemma · mradermacher
Params2.61B
Context8K
Q4_K_M1.7 GB
BA
BartaLens E2B
Bartalens · mradermacher
Params4.65B
Context128K
Q4_K_M3.4 GB
GE
Amoral Gemma3 12B Vision
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma 3 4b It
Gemma · gsxrchris
Params3.88B
Context128K
Q4_K_M2.5 GB
GE
Gemma3 9b It Girl v1
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma3 1B Tools
Gemma · iromu
Params1B
Context32K
Q4_K_M0.8 GB
GE
Gemma 4 21b A4B It REAP
Gemma · Ayodele01
Params20.8B
Context256K
Q4_K_M13.8 GB
GE
PopiT Gemma 3 12B Medical SFT 1218
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
GE
Gemma2 9b WangchanLIONv2 instruct
Gemma · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma 3n E4B It Absolute Heresy
Gemma · MuXodious
Params6.87B
Context32K
Q4_K_M4.2 GB
CR
Crow 9B It
Crow · mradermacher
Params9.24B
Context8K
Q4_K_M5.8 GB
DI
diffusiongemma 26B A4B it
Diffusiongemma · AlexAtomic
Params25.3B
Context256K
Q4_K_M16.8 GB
GE
Gemma 3 4b It Roleplay Tuned v1
Gemma · mradermacher
Params3.88B
Context128K
Q4_K_M2.5 GB