GGUF models by Otakadelic

101 GGUF models quantized by Otakadelic on Hugging Face. Sizes run from 1B to 31.4B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
MTMaMe Merge 02012025163610 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen6 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Merge7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Gen8 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Gen9 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Merge9 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen10 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen11 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT1 Gen8 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT1 Gen11 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GGUF

Keep browsing