GGUF models by zelk12

79 GGUF models quantized by zelk12 on Hugging Face. Sizes run from 2.9B to 11.8B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MT Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
Vision
GE
Gemma 2 TM 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT Gen6fix gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
Rv0.4DMv1t0.25 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT Merge1 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT Gen2 Gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
Rv0.4DMv1t0.25Tt0.25 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MTMMe Merge gemma 2 9B NuSLERP w0.7 0.3 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT3 Gen10 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT Gen11 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT1 Gen11 gemma 2 9B Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MT1 Gen13 Gemma 2 9B
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
26_05_2025_Test1_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
MT1 Gen12 Gemma 2 9B
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
MTMMe Merge gemma 2 9B NuSLERP Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
26_05_2025_Test_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF
GE
MTMMe Merge gemma 2 9B NuSLERP w0.3 0.7 Q6 K
Gemma · zelk12
Params9.24B
Context8K
Smallest7.6 GB
GGUF
GE
28_05_2025_Test2_LazyMergekit_gemma 3 12B
Gemma · zelk12
Params11.8B
Context128K
Smallest9.7 GB
GGUF

Keep browsing