GGUF models by Agnuxo
93 GGUF models quantized by Agnuxo on Hugging Face. Sizes run from 4M to 12.2B parameters. The longest trained context is 1000K tokens.
CA
cajal 9b v2 q8 0
Cajal · Agnuxo
Params8.95B
Context256K
Smallest9.5 GB
CA
cajal 9b v2 q6 k
Cajal · Agnuxo
Params8.95B
Context256K
Smallest7.4 GB
CA
cajal 9b v2 q5 k m
Cajal · Agnuxo
Params8.95B
Context256K
Smallest6.5 GB