Gemma GGUF models

13341 GGUF models in the Gemma family, quantized by 4460 uploaders. Sizes run from 2M to 70.6B parameters. The longest trained context is 1280000K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
GE
Huihui Gemma 4 31B It Abliterated v2
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma4 Gutenberg 31B
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Vision
GE
Gemma-3-12B-It-Qat-Int4
Gemma · unsloth
Params11.8B
Context128K
Q4_K_M7.3 GB
Vision
GE
gemma 2 27b it abliterated
Gemma · QuantFactory
Params27.2B
Context8K
Q4_K_M16.6 GB
GGUF
GE
GemmaTheWriter
Gemma · DavidAU
Params9.24B
Context8K
Q4_K_M5.8 GB
Roleplay
GE
gemma 4 12B coder fable5 composer2.5 v1
Gemma · ScottzillaSystems
Params11.9B
Context256K
Q4_K_M7.4 GB
CodingReasoning
GE
Gemma 3 1b It Qat
Gemma · bartowski
Params1B
Context32K
Q4_K_M0.8 GB
GGUF
GE
medgap gemma 4 12b
Gemma · protocolsyncllc
Params11.9B
Context256K
Smallest0.5 GB
ReasoningTool useVision
GE
Gemma 4 31B Loki Scotoma V2.0 Swa 4096
Gemma · CrucibleLab
Params30.7B
Context256K
Q4_K_M18.7 GB
Roleplay
GE
gemma 4 31B it qat uncensored heretic UDmerge
Gemma · EZForever
Params30.7B
Context256K
Smallest17.3 GB
Vision
GE
gemma 4 E4B it heretic
Gemma · igorls
Params7.5B
Context128K
Q4_K_M5.3 GB
Vision
GE
KaLM Embedding Gemma3 12B 2511
Gemma · mradermacher
Params11.8B
Context128K
Q4_K_M7.3 GB
Embedding
GE
Gemma 3 4B it Uncensored
Gemma · lemuralabs
Params3.88B
Context128K
Smallest1.2 GB
GGUF
GE
Gemma 3 12b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params11.8B
Context128K
Smallest7.1 GB
Vision
GE
Gemma 4 26B A4B It Heretic Ara v2
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
GGUF
GE
Gemma-4-26B-A4B-It
Gemma · Kremon96
Params25.2B
Context256K
Q4_K_M16.9 GB
ReasoningTool useVision
GE
Gemma 4 31B It Mystery Fine Tune HERETIC UNCENSORED Thinking
Gemma · mradermacher
Params30.7B
Context256K
Q4_K_M18.7 GB
CodingReasoningRoleplay
GE
Tiger Gemma 12B v3
Gemma · TheDrummer
Params12.8B
Context128K
Q4_K_M7.9 GB
GGUF
GE
Gemma 4 12B It Abliterated Uncensored
Gemma · mradermacher
Params11.9B
Context128K
Q4_K_M7.4 GB
Vision
GE
Gemma 4 12B it AEON Abliterated K4
Gemma · Abiray
Params11.9B
Context128K
Q4_K_M7.4 GB
ReasoningTool use
GE
Gemma SEA LION v4 4B VL
Gemma · aisingapore
Params3.88B
Context128K
Q4_K_M2.5 GB
Vision
GE
Huihui Gemma 4 26B A4B It Abliterated
Gemma · mradermacher
Params25.2B
Context256K
Q4_K_M16.8 GB
Vision
GE
Gemma 4 E4B It Uncensored
Gemma · mradermacher
Params7.52B
Context128K
Q4_K_M5.3 GB
ReasoningTool use
GE
gemma-3-27b-it-codeforces-SFT
Gemma · bartowski
Params27B
Context128K
Q4_K_M16.5 GB
Reasoning
GE
Gemma 4 19B A4B It The DECKARD Heretic Uncensored Thinking
Gemma · mradermacher
Params18.4B
Context256K
Q4_K_M12.3 GB
CodingReasoningRoleplay
GE
Gemma 4 12B It Qat Q4_0 Uncensored Heretic
Gemma · llmfan46
Params11.9B
Context256K
Smallest7.6 GB
Vision
GE
Gemma 4 31B It SDFT Heretic RP
Gemma · bartowski
Params30.7B
Context256K
Q4_K_M19.6 GB
Roleplay
GE
gemma-4-31B-it-uncensored-biproj
Gemma · ressl
Params30.7B
Context256K
Q4_K_M18.7 GB
GGUF
GE
Gemma 4 31B it abliterated
Gemma · LiconStudio
Params30.7B
Context256K
Q4_K_M18.7 GB
Vision
GE
Gemma 3 1b It Qat Q4_0 Unquantized
Gemma · ggml-org
Params1B
Context32K
Smallest0.7 GB
GGUF

Keep browsing