Aya GGUF models

240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AY
Aya Expanse 8b
Aya · zeuvue
Params8.03B
Context8K
Smallest5.8 GB
GGUF
AY
Aya Expanse 8b
Aya · thanhh12
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya X Yeni
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest5.7 GB
GGUF
AY
Aya Expanse 32b
Aya · Abu-Dju
Params32.3B
Context8K
Smallest34.3 GB
GGUF
AY
Aya Expanse 8b
Aya · grapevine-AI
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya v0.2 Q4 K M
Aya · xiaoheiqaq
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · AaronFeng753
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
Aya 8B 2B KL
Aya · mradermacher
Params2.58B
Context8K
Q4_K_M1.8 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · AaronFeng753
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b
Aya · win10
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b
Aya · skchoi1015
Params8.03B
Context8K
Smallest5.8 GB
GGUF
AY
Aya Expanse 8b
Aya · Iatalking
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya-23-8B
Aya · zlyva
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 32b
Aya · BEOBMA
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b
Aya · zolastro
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
Aya v0.2 i1
Aya · mradermacher
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya Expanse 8b
Aya · thanhh12
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
Aya Test Model V2
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Hermes 13B
Aya · doruoros
Params11.3B
Context8K
Q4_K_M7.0 GB
Tool use
AY
Aya X
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest6.6 GB
GGUF
AY
Aya Expanse 32b
Aya · Lucy-in-the-Sky
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
aya-23-8B
Aya · ZeroWw
Params8.03B
Context8K
Smallest7.0 GB
GGUF
AY
Aya Expanse 8b
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya23 35B Hok v3
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Aya Empati v3
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GGUF

Keep browsing