Jais GGUF models

103 GGUF models in the Jais family, quantized by 12 uploaders. Sizes run from 385M to 72.7B parameters. The longest trained context is 512K tokens.

TinySmallMediumLarge
Most downloadedNewestLargestLongest contextSmallest
JA
jais 30b chat v3 fp16
Jais · mradermacher
Params30.8B
Context8K
Smallest21.7 GB
GGUF
JA
jais-13b
Jais · dormosh
Params13.5B
Context2K
Smallest16.9 GB
GGUF
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest10.4 GB
Coding
JA
Jais 13b Chat
Jais · NikolayKozloff
Params13.5B
Context2K
Smallest14.4 GB
Coding
JA
jais-30b-v1
Jais · dormosh
Params30.8B
Context2K
Smallest38.9 GB
GGUF
JA
Jais-Inception-70b-V1.1
Jais · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
JA
Jais Family 13b Chat
Jais · samiazzam
Params13.5B
Context2K
Q4_K_M9.0 GB
Coding
JA
Jais Adapted 7b Chat
Jais · Solshine
Params7B
Context4K
Q4_K_M4.3 GB
Coding
JA
Jais Adapted 7b Chat
Jais · Felladrin
Params7B
Context4K
Smallest3.5 GB
GGUF
JA
Jais Family 30b 16k Chat
Jais · samiazzam
Params30.8B
Context16K
Q4_K_M27.9 GB
Coding
JA
Jais-Inception-70b-V1.2
Jais · mradermacher
Params72.7B
Context128K
Q4_K_M47.4 GB
GGUF
JA
jais-13b-chat
Jais · dormosh
Params13.5B
Context2K
Smallest16.9 GB
GGUF
JA
Jais-3-32B
Jais · webmp3
Params34.8B
Context512K
Q4_K_M21.1 GB
ReasoningTool use

Keep browsing