GGUF models by zelk12
79 GGUF models quantized by zelk12 on Hugging Face. Sizes run from 2.9B to 11.8B parameters. The longest trained context is 128K tokens.
GE
MT3 Gen1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
T31122024203920 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT2 Gen1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
recoilme gemma 2 9B v0.3 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT2 Gen9 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT4 Gen2 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
recoilme gemma 2 Ifable 9B v0.1 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT1 Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT5 Gen3_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT5 Gen2_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT7 Gen3_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT1 Gen1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT Gen1 Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
30_05_2025_Test4_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT2 Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
Gemma 3 12b It v3 Merged
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
recoilme gemma 2 9B v0.4 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
recoilme gemma 2 Ataraxy 9B v0.1 t0.375 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MTM Merge1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT2 Gen11 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
T31122024S2 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT4 Max Merge 02012025163610 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT1 Gen6 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT1 Gen2_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT1 Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
29_05_2025_Test3_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
Gemma R1 12B v3
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT Gen12 Gemma 2 9B
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
Saiga_Gemma3_12B_Sft_M1_D39_Smpo_M1_D38
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
recoilme gemma 2 psy10k mental healt 9B v0.1 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB