Aya GGUF models

240 GGUF models in the Aya family, quantized by 65 uploaders. Sizes run from 24M to 35B parameters. The longest trained context is 4194304K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
AY
Aya Expanse 32b
Aya · duyntnet
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya23 8b
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b
Aya · prithivMLmods
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b Heretic
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
aya
Aya · cortexso
Params35B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya 101
Aya · kcoopermiller
Params12.9B
Context—
Smallest4.2 GB
GGUF
AY
aya-23-8B
Aya · backyardai
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 14B EXP
Aya · mradermacher
Params14.8B
Context8K
Q4_K_M9.1 GB
GGUF
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
aya-23-35B
Aya · lmstudio-community
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Aya Expanse 32b Heretic MPOA
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 32b Heretic
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b Abliterated
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya-23-35B
Aya · mmnga
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Aya Enes B4
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 32b
Aya · lmstudio-community
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya Expanse 8b Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Expanse 8b Orthogonal Heretic
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Medikal V2
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Models lenML Aya Expanse 8b Abliterated
Aya · MaziyarPanahi
Params8.03B
Context8K
Smallest5.7 GB
GGUF
AY
CohereForAI Aya Expanse 8b
Aya · tensorblock
Params8.03B
Context8K
Smallest3.4 GB
GGUF
AY
aya-23-35B
Aya · legraphista
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
aya-23-8B
Aya · lmstudio-community
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya 23 8B
Aya · matrixportalx
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
CohereForAI.aya Expanse 8b
Aya · DevQuasar-3
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya Empati
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
aya-23-35B
Aya · mradermacher
Params35B
Context8K
Q4_K_M21.5 GB
GGUF
AY
Aya Expanse 32b Abliterated
Aya · mradermacher
Params32.3B
Context8K
Q4_K_M19.8 GB
GGUF
AY
Aya 23 8b Oscar
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF
AY
Aya X Mod
Aya · mradermacher
Params8.03B
Context8K
Q4_K_M5.1 GB
GGUF

Keep browsing