GGUF models by taronaeo

34 GGUF models quantized by taronaeo on Hugging Face. Sizes run from 23M to 32.2B parameters. The longest trained context is 1024K tokens.

Most downloadedNewestLargestLongest contextSmallest
GR
Granite 3.1 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
GGUF
LL
Llama 3.2 1B Instruct BE
Llama · taronaeo
Params1.24B
Context128K
Q4_K_M0.8 GB
GGUF
QW
Qwen2.5 7B Instruct BE
Qwen · taronaeo
Params7.62B
Context32K
Q4_K_M4.7 GB
GGUF
BO
Bonsai 8B BE
Bonsai · taronaeo
Params8.19B
Context64K
Smallest1.2 GB
GGUF

Keep browsing