Aya GGUF models

240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AY
aya expanse 8bf16
Aya · sdyy
Params8.03B
Context8K
Smallest16.1 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest4.2 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 32b
Aya · Lucy-in-the-Sky
Params32.3B
Context8K
Smallest12.8 GB
GGUF
AY
aya 8b 1k 8r 150epoch
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya_Hamdi
Aya · AyaHm
Params24M
Context—
Smallest0.1 GB
GGUF
AY
Aya Empati v3
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya sl biz 8b
Aya · DiYaZeN
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · thanhh12
Params8.03B
Context8K
Smallest6.6 GB
GGUF
AY
aya cpo 50 Q4 K M
Aya · PhucMinh111
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Empati
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b
Aya · latios01
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
aya 8b 1k 16r 150epoch
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Test Model V1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya X Mod
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · YiHuan
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya 8b 1k 128r 100epoch
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya cpo 20 Q8 0
Aya · PhucMinh111
Params8.03B
Context8K
Smallest8.5 GB
GGUF
AY
aya 8b 1k 32r 200epoch
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya v0.4 Q4 K M
Aya · xiaoheiqaq
Params8.03B
Context8K
Q4_K_M4.9 GB
GGUF
AY
Aya v0.5 Q4 K M
Aya · xiaoheiqaq
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya v0.6.1 Q4 K M
Aya · xiaoheiqaq
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya v0.6.0 Q4 K M
Aya · xiaoheiqaq
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
aya v0.2 q4 k m
Aya · SoutaCantOnline
Params7.25B
Context32K
Q4_K_M4.4 GB
GGUF
AY
Aya 23 8B Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · Hyphonical
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya 8b 1k 32r 150epoch
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 8B
Aya · ijohn07
Params8.03B
Context8K
Smallest3.4 GB
GGUF

Keep browsing