GGUF models by Otakadelic

101 GGUF models quantized by Otakadelic on Hugging Face. Sizes run from 1B to 31.4B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MTMMe Merge gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen11 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GE
MT Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
gemma 2 9B it blend Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MTMMe Merge gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT1 Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT1 Gen6 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma Chat 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT2 Gen11 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GE
MT2 Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT3 Gen7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen9 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GE
MT3 Gen9 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT3 Gen9 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Merge9 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GE
MT Gen11 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GE
MT Gen6 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen6fix gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Merge6 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Merge7 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen8 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MTM Merge1 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen11 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT1 Gen12 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF

Keep browsing