Aya GGUF models

240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AY
Adamo1139 Aya Expanse 32b Ungated
Aya · tensorblock
Params32.3B
Context8K
Smallest12.8 GB
GGUF
AY
Aya TR V1
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya 23 35B
Aya · grapevine-AI
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
CohereLabs Aya 23 8B
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya v0.6.0
Aya · mradermacher
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya Expanse 8b
Aya · thanhh12
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
Aya Expanse 32b
Aya · itlwas
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 32b
Aya · Abu-Dju
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b
Aya · YorkieOH10
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest5.7 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
CohereLabs Aya 23 35B
Aya · tensorblock
Params35B
Context8K
Smallest13.8 GB
GGUF
AY
Aya Expanse 32b
Aya · Kman3107
Params32.3B
Context8K
Smallest14.7 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
Aya Expanse 8b
Aya · skchoi1015
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b
Aya · grapevine-AI
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b
Aya · thanhh12
Params8.03B
Context8K
Smallest5.7 GB
GGUF
AY
Aya23 35B Hok v2
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Aya Expanse 8b
Aya · NikolayKozloff
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
Aya Expanse 8b
Aya · ZeroWw
Params8.03B
Context8K
Smallest9.5 GB
GGUF
AY
Aya Expanse 32b Abliterated
Aya · itlwas
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
Aya 3B
Aya · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
AY
Aya Expanse 32b
Aya · win10
Params32.3B
Context8K
Smallest23.1 GB
GGUF
AY
Aya Expanse 8b
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
Aya 23 8b Oscar
Aya · PhucMinh111
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
Aya Expanse 8b
Aya · zeuvue
Params8.03B
Context8K
Smallest5.7 GB
GGUF
AY
Aya Expanse 8b
Aya · rashidimam
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF

Keep browsing