Jais GGUF models
103 GGUF models in the Jais family, quantized by 12 uploaders. Sizes run from 385M to 72.7B parameters. The longest trained context is 512K tokens.
JA
jais 30b chat v3 fp16
Jais · mradermacher
Params30.8B
Context8K
Smallest21.7 GB
JA
jais-13b
Jais · dormosh
Params13.5B
Context2K
Smallest16.9 GB
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest10.4 GB
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest14.4 GB
JA
jais-30b-v1
Jais · dormosh
Params30.8B
Context2K
Smallest38.9 GB
JA
Jais-Inception-70b-V1.1
Jais · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
JA
Jais Family 13b Chat
Jais · samiazzam
Params13.5B
Context2K
Q4_K_M9.0 GB
JA
Jais Adapted 7b Chat
Jais · Solshine
Params7B
Context4K
Q4_K_M4.3 GB
JA
Jais Adapted 7b Chat
Jais · Felladrin
Params7B
Context4K
Smallest3.5 GB
JA
Jais Family 30b 16k Chat
Jais · samiazzam
Params30.8B
Context16K
Q4_K_M27.9 GB
JA
Jais-Inception-70b-V1.2
Jais · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
JA
jais-13b-chat
Jais · dormosh
Params13.5B
Context2K
Smallest16.9 GB
JA
Jais-3-32B
Jais · webmp3
Params34.8B
Context512K
Q4_K_M21.1 GB