Aya GGUF models

240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AY
Aya v0.6.1
Aya · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya Empati v2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Z
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya v0.4
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
Aya 14B EXP i1
Aya · mradermacher
Params14.8B
Context8K
Q4_K_M9.1 GB
GGUF
AY
Aya X Mod V1
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya TR V2
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya X Yeni
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya X Mod
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Medikal
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Enes I2 8
Aya · mradermacher
Params6.28B
Context8K
Q4_K_M4.0 GB
GGUF
AY
aya-23-8B
Aya · mmnga
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8B Storywriter Exp 5
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b
Aya · Abu-Dju
Params32.3B
Context8K
Smallest23.1 GB
GGUF
AY
CohereForAI.aya Expanse 32b
Aya · DevQuasar-4
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya 23 8b Oscar
Aya · RichardErkhov
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 7b
Aya · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya IT FULL
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya v0.2
Aya · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
AY
CohereForAI Aya Expanse 32b
Aya · tensorblock
Params32.3B
Context8K
Smallest12.8 GB
GGUF
AY
aya-23-35B
Aya · backyardai
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
aya expanse
Aya · cortexso
Params32.3B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya-23-35B
Aya · LiteLLMs
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
aya-23-8B
Aya · legraphista
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya expanse 8b
Aya · neopolita
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · RichardErkhov
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · cstr
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF

Keep browsing