GGUF models by Otakadelic
101 GGUF models quantized by Otakadelic on Hugging Face. Sizes run from 1B to 31.4B parameters. The longest trained context is 128K tokens.
GE
MTMaMe Merge 02012025163610 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT1 Gen6 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Merge7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Gen8 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Gen9 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Merge9 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen10 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT1 Gen11 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT1 Gen8 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT1 Gen11 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB