Aya GGUF models
240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.
AY
aya-23-8B
Aya · MoMonir
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya Z i1
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya 23 35B
Aya · itlwas
Params35B
Context8K
Q4_K_M21.5 GB
AY
CohereForAI Aya 23 35B
Aya · tensorblock
Params35B
Context8K
Smallest13.8 GB
AY
CohereForAI Aya 23 8B
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
AY
Aya 3B i1
Aya · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
AY
Aya 8B 2B KL i1
Aya · mradermacher
Params2.58B
Context8K
Q4_K_M1.8 GB
AY
aya expanse 8b lexsi aligntune
Aya · CardCauldronTCG
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
AYA 8B
Aya · mradermacher
Params8.02B
Context8K
Q4_K_M5.1 GB
AY
Aya TR V1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
aya vision 8b
Aya · mobilint
Params8B
Context4K
Smallest0.0 GB
AY
Aya Expanse 8b Orthogonal Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
aya-23-8B
Aya · svjack
Params8.03B
Context8K
Smallest4.8 GB
AY
Aya Expanse 8b
Aya · ZeroWw
Params8.03B
Context8K
Smallest5.3 GB
AY
Aya 23 8B
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya 23 35B
Aya · Lucy-in-the-Sky
Params35B
Context8K
Smallest13.8 GB
AY
Aya Expanse 32b
Aya · Lucy-in-the-Sky
Params32.3B
Context8K
Smallest34.3 GB
AY
Aya 7b
Aya · xiaoheiqaq
Params7.24B
Context32K
Q4_K_M4.4 GB
AY
aya-23-35B
Aya · zlyva
Params35B
Context8K
Q4_K_M21.5 GB
AY
Matrixportal Aya Z
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
AY
aya expanse 8b abliterated Q4 0
Aya · Sashkanik13
Params8.03B
Context8K
Smallest4.8 GB
AY
aya-23-8B
Aya · LiteLLMs
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya 23 8B Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya Expanse 8b
Aya · zeuvue
Params8.03B
Context8K
Smallest4.6 GB
AY
Aya Expanse 8b Heretic Brain
Aya · oncu
Params8.03B
Context8K
Smallest4.8 GB
AY
Aya Expanse 8b Abliterated
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya TR V2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.9 GB
AY
aya 8b
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB