Athena GGUF models

122 GGUF models in the Athena family, quantized by 17 uploaders. Sizes run from 494M to 120B parameters. The longest trained context is 1024K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AT
Athena Codegemma 2 9b
Athena · Nekuromento
Params9.24B
Context8K
Smallest7.6 GB
GGUF
AT
Athena R3 7B Q4 K M
Athena · irmma
Params7.62B
Context128K
Q4_K_M4.7 GB
Tool use

Keep browsing