Aya GGUF models

240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AY
Aya Not Using Only Test
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Empati v2
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya23 35B Hok v3
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
aya 8b 1k 256r 150epoch
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 8B
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · NovNovikov
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 8b
Aya · jeanflop
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b Ungated
Aya · netnk9151
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b
Aya · thanhh12
Params8.03B
Context8K
Smallest4.2 GB
GGUF
AY
Aya Empati v1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya-23-8B
Aya · NikolayKozloff
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest4.5 GB
GGUF
AY
aya-23-8B
Aya · NovNovikov
Params8.03B
Context8K
Smallest6.6 GB
GGUF
AY
Aya Medikal Test1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest5.8 GB
GGUF
AY
Aya Expanse 8b
Aya · huggingkot
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · Lucy-in-the-Sky
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
Aya Expanse 8b
Aya · houghtob123
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Z
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest3.9 GB
GGUF
AY
aya 8b ger finet
Aya · MatterhornMatters
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.0 GB
GGUF
AY
Aya Testing Only v13
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · Lkdosth
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Ungated
Aya · am0n666x
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
aya-23-8B
Aya · e2jhiubyiiyvw
Params8.03B
Context8K
Smallest5.8 GB
GGUF
AY
aya cpo 20 Q4 K M
Aya · PhucMinh111
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 8b Oscar
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya 8b ger en finet
Aya · MatterhornMatters
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF

Keep browsing