GGUF models by Otakadelic

101 GGUF models quantized by Otakadelic on Hugging Face. Sizes run from 1B to 31.4B parameters. The longest trained context is 128K tokens.

Most downloadedNewestLargestLongest contextSmallest
GE
recoilme gemma 2 Ataraxy 9B v0.1 t0.25 Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT3 Gen11 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
MI
Magistral 2509 31B
Mistral · Otakadelic
Params31.4B
Context128K
Q4_K_M19.0 GB
ReasoningTool use
MI
Magistral 2509 31B
Mistral · Otakadelic
Params31.4B
Context128K
Smallest25.7 GB
ReasoningTool use
GE
MT1 Gen10 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT5 Max Merge 02012025163610 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
ME
Mergekit Model_Stock Prczfmj
Mergekit · Otakadelic
Params27B
Context128K
Smallest22.2 GB
GGUF
GE
MT Gen13 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Gen2 Gemma 3 12B
Gemma · Otakadelic
Params11.8B
Context128K
Q4_K_M7.3 GB
GGUF
GE
MT2 Gen8 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen13 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
PH
Phi 4 Empathetic
Phi · Otakadelic
Params14.7B
Context16K
Smallest12.0 GB
GGUF
ME
Mergekit Model_Stock Prczfmj
Mergekit · Otakadelic
Params27B
Context128K
Smallest19.3 GB
GGUF
GE
MT3 Gen7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
Gemma Creative 9B Base Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT3 Gen8 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MTMMe Merge gemma 2 9B NuSLERP w0.7 0.3 Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT3 Gen6 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen8 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT2 Gen8 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT3 Gen8 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen9 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT1 Gen13 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT Gen13 Gemma 2 9B
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT2 Gen11 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT2 Gen7 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT Gen10 gemma 2 9B Q4 K M
Gemma · Otakadelic
Params9.24B
Context8K
Q4_K_M5.8 GB
GGUF
GE
MT1 Gen10 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF
GE
MT3 Gen11 gemma 2 9B Q5 K M
Gemma · Otakadelic
Params9.24B
Context8K
Smallest6.6 GB
GGUF
GE
MT Merge6 gemma 2 9B Q8 0
Gemma · Otakadelic
Params9.24B
Context8K
Smallest9.8 GB
GGUF

Keep browsing