GGUF models by zelk12
79 GGUF models quantized by zelk12 on Hugging Face. Sizes run from 2.9B to 11.8B parameters. The longest trained context is 128K tokens.
GE
MT Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
Gemma 2 TM 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT Gen6fix gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
Rv0.4DMv1t0.25 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT Merge1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT Gen2 Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
Rv0.4DMv1t0.25Tt0.25 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MTMMe Merge gemma 2 9B NuSLERP w0.7 0.3 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT3 Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT Gen11 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT1 Gen11 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MT1 Gen13 Gemma 2 9B
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
26_05_2025_Test1_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MT1 Gen12 Gemma 2 9B
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
MTMMe Merge gemma 2 9B NuSLERP Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
26_05_2025_Test_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GE
MTMMe Merge gemma 2 9B NuSLERP w0.3 0.7 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GE
28_05_2025_Test2_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB