GGUF models by Otakadelic
101 GGUF models quantized by Otakadelic on Hugging Face. Sizes run from 1B to 31.4B parameters. The longest trained context is 128K tokens.
GE
MTMMe Merge gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen11 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GE
MT Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT1 Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
gemma 2 9B it blend Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MTMMe Merge gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT1 Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT1 Gen6 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
Gemma Chat 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT2 Gen11 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GE
MT2 Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT3 Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen9 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GE
MT3 Gen9 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT3 Gen9 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Merge9 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GE
MT Gen11 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT1 Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GE
MT Gen6 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen6fix gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Merge6 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT Merge7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen8 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MTM Merge1 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT Gen11 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GE
MT1 Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GE
MT1 Gen7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB