Aya GGUF models

240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AY
aya-23-8B
Aya · MoMonir
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Z i1
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 35B
Aya · itlwas
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
CohereForAI Aya 23 35B
Aya · tensorblock
Params35B
Context8K
Smallest13.8 GB
GGUF
AY
CohereForAI Aya 23 8B
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
Aya 3B i1
Aya · mradermacher
Params3.09B
Context32K
Q4_K_M1.9 GB
GGUF
AY
Aya 8B 2B KL i1
Aya · mradermacher
Params2.58B
Context8K
Q4_K_M1.8 GB
GGUF
AY
aya expanse 8b lexsi aligntune
Aya · CardCauldronTCG
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
AYA 8B
Aya · mradermacher
Params8.02B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya TR V1
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya vision 8b
Aya · mobilint
Params8B
Context4K
Smallest0.0 GB
Vision
AY
Aya Expanse 8b Orthogonal Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya-23-8B
Aya · svjack
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 8b
Aya · ZeroWw
Params8.03B
Context8K
Smallest5.3 GB
GGUF
AY
Aya 23 8B
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 35B
Aya · Lucy-in-the-Sky
Params35B
Context8K
Smallest13.8 GB
GGUF
AY
Aya Expanse 32b
Aya · Lucy-in-the-Sky
Params32.3B
Context8K
Smallest34.3 GB
GGUF
AY
Aya 7b
Aya · xiaoheiqaq
Params7.24B
Context32K
Q4_K_M4.4 GB
GGUF
AY
aya-23-35B
Aya · zlyva
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Matrixportal Aya Z
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
aya expanse 8b abliterated Q4 0
Aya · Sashkanik13
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
aya-23-8B
Aya · LiteLLMs
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 8B Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · zeuvue
Params8.03B
Context8K
Smallest4.6 GB
GGUF
AY
Aya Expanse 8b Heretic Brain
Aya · oncu
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · itlwas
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya TR V2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest4.8 GB
GGUF
AY
Aya Expanse 8b
Aya · matrixportalx
Params8.03B
Context8K
Smallest3.9 GB
GGUF
AY
aya 8b
Aya · SirAB
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF

Keep browsing