GGUF models by taronaeo
34 GGUF models quantized by taronaeo on Hugging Face. Sizes run from 23M to 32.2B parameters. The longest trained context is 1024K tokens.
GR
Granite 3.1 2B Instruct BE
Granite · taronaeo
Params2.53B
Context128K
Q4_K_M1.5 GB
LL
Llama 3.2 1B Instruct BE
Llama · taronaeo
Params1.24B
Context128K
Q4_K_M0.8 GB
QW
Qwen2.5 7B Instruct BE
Qwen · taronaeo
Params7.62B
Context32K
Q4_K_M4.7 GB
BO
Bonsai 8B BE
Bonsai · taronaeo
Params8.19B
Context64K
Smallest1.2 GB