GGUF models by zelk12

79 GGUF models quantized by zelk12 on Hugging Face. Sizes run from 2.9B to 11.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MT3 Gen1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
T31122024203920 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT2 Gen1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
recoilme gemma 2 9B v0.3 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT2 Gen9 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT4 Gen2 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
recoilme gemma 2 Ifable 9B v0.1 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT1 Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
Vision
GE
MT5 Gen3_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
Vision
GE
MT5 Gen2_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
Vision
GE
MT7 Gen3_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
Vision
GE
MT1 Gen1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT Gen1 Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
Vision
GE
30_05_2025_Test4_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
MT2 Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
Gemma 3 12b It v3 Merged
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
recoilme gemma 2 9B v0.4 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
recoilme gemma 2 Ataraxy 9B v0.1 t0.375 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MTM Merge1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT2 Gen11 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
T31122024S2 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT4 Max Merge 02012025163610 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT1 Gen6 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT1 Gen2_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
MT1 Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
29_05_2025_Test3_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
Gemma R1 12B v3
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
Reasoning
GE
MT Gen12 Gemma 2 9B
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
Saiga_Gemma3_12B_Sft_M1_D39_Smpo_M1_D38
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
recoilme gemma 2 psy10k mental healt 9B v0.1 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF

Keep browsing